Transcript Document
Quality of experience measurements Technologies and who knows what Jörgen Gustafsson Ericsson Research Are the horizontal lines parallel? Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 2 Yes they are! Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 3 How much darker is square A than square B? Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 4 …. Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 5 …. Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 6 …. Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 7 Not at all! Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 8 Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 9 Subjective test x 250 › x 24 5 4 3 2 1 excellent good fair poor bad Mean Opinion Score Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 10 Capturing perception QoE models: Codec: signaling MOS = f(x, y, z, …) Combining in a nonlinear way Non-linear dependency between perceived quality and IP and application layer measurements Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 11 Audiovisual quality (MOS) Parametric model P.1201 Parameter extraction c1 c2 IP headers c3 video … Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 12 a/v-mos Audiovisual Stream info Buffering V-mos audio a-mos QoE model Standardization › ITU-T Study Group 9 and 12 › Recently approved P.1201 and P.1202 recommendations for UDP based video › New work items for progressive download (YouTube) and adaptive streaming (DASH) Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 13 Measurement accuracy Binary: Good or bad Ideal Real QoE Medium accuracy Good QoS Detailed comparison possible QoE estimation Accuracy of method Useful Not useful Action? Transport layer measurements Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 14 Modeling human perception Asking the man on the bus How close to real perception Service provider Media client reports CDN (Content Delivery Network) IP level measurement data ISP (Internet Service Provider) IP and access network data End user Quality of Experience! Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 15 Ultimate QoE measurement data set Panel discussion › Is the quality of media services (in Sweden, today) good enough? › What QoE measurements are done today and what is missing? › What accuracy of the QoE measurements is desirable? › What are the reasons to share QoE measurement with other actors? › Who does a user call when there are quality problems? › What are the end-users willing to pay for in terms of quality? › What new business models can emerge using novel QoE measurement technologies? Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 16 Summary › Human perception is utterly complex… › …but we can handle that with QoE models › A lot of QoE measurement data is available › …but no one has access to all the data › Potential for new business models Ericsson Internal | © Ericsson AB 2013 | 2013-02-10 | Page 17