Qoe Measurement in The NGN - A Market Perspective
Qoe Measurement in The NGN - A Market Perspective
Qoe Measurement in The NGN - A Market Perspective
ITU-T
Dr Mike Hollier
CTO Psytechnics
ITU-T
o Industry Landscape
o Quality as a critical economic success factor
o What is “quality” anyway?
o Why existing metrics are not enough
o A new generation of methods and standards
o Industry examples
o Next steps … key standards needed!
o Summary
ITU-T
o Traditional telcos – falling voice revenue and rising OPEX
o New wave SPs - delivering new economic models
o Technology discontinuity
• Analogue to Digital
• Circuit-switched to packet-switched
o Changing market place
• De-regulation
• Intense competition
o Industry’s new imperatives
• Reduce OPEX, increase ARPU
o Leading to:
• NGN – reduce opex, drive up ARPU
• Convergence, IMS
• NWM to CEM
• Wideband and multi-media services
ITU-T Workshop on “End-to-End QoE/QoS“
Geneva, 14-16 June 2006 3
Service design and deployment - IMS
ITU-T
100 Economic viability
90
thresholds
80
70
60
% user
PS threshold
50
applicability 40
30
20
10
IMS threshold
0
A B C D E F G H
Services
ITU-T
o Quality driven economics
• SLA – thresholds and reports
• Directed maintenance
• Targeted investment
• Efficient operation, e.g. interconnect
selection
• Quality differentiated services
• Billing – billable quality
o Competitive quality essential
• Service re-use
• Customer retention
ITU-T Workshop on “End-to-End QoE/QoS“
Geneva, 14-16 June 2006 5
What is “quality” anyway?
ITU-T
o Baseline for quality is customer
opinion/satisfaction
o Customer satisfaction is a blend of;
availability, quality, price and utility
o I think I am safe in not explaining objective
and subjective testing to this group ;-)
o New subjective and objective methods are
required to inform QoE based network
operation.
ITU-T
o Must detect onset of dissatisfaction without complaint*
• measurements must be real-time and per-session
• must address QoE, e.g. conversational quality rather than one-
way listening quality
• Wideband and multi-media
o This data informs a commercial decision which dictates
accuracy requirements
• don’t be fooled by “traffic lights” requirements
ITU-T
e.g.
-Mobile: Radio Signal (RxQual,
RxLev, BER), Customer Surveys
and/or complaints, Network KPI’s
Delay
Jitter -IP Telephony: packet loss, jitter &
Packet-loss delay used to estimate VoIP network
quality
ITU-T Workshop on “End-to-End QoE/QoS“
Geneva, 14-16 June 2006 8
Beyond Simple Networks statistics
ITU-T
ITU-T
Active Passive
(Intrusive) (Non-Intrusive)
Agent IP Monitor Monitor
Voice PSA PSI PSM
Psytechnics Speech Agent Psytechnics Speech IP Monitor Psytechnics Speech Monitor
P.563 (SEAM)
P.862 (PESQ) P.VTQ P.562 (CCI)
P.561 (INMD)
Conversational, P.CQO
Video
PVA PVI PVM
Psytechnics Video Agent Psytechnics Video IP Monitor Psytechnics Video Monitor
J.144
ITU-T
ITU-T
ITU-T
ITU-T