Quality of experience evaluation for multimedia services

• Autorzy: Grega M. , Janowski L. , Leszczuk M. , Romaniak P. , Papir Z.

Warianty tytułu

EN

Szacowanie postrzeganej jakości usług (QoE) komunikacji multimedialnej

• Konferencja: Krajowa Konferencja Radiokomunikacji Radiofonii i Telewizji (09-11.04.2008 ; Wrocław, Polska)
• Języki publikacji: PL

Abstrakty

PL

Postrzegana jakość usług (QoE) stanowi rozszerzenie tradycyjnej jakości usług (QoS). Jakość usług QoS jest zestawem liczbowych wskaźników opisujących efektywność działania sieci transmisyjnej, natomiast postrzegana jakość usług QoE jest miernikiem poziomu zadowolenia użytkownika z jakości otrzymywanych usług. Artykuł przedstawia przesłanki za szerszym stosowaniem postrzeganej jakości usług oraz zasady jej wyznaczania, a podstawowe pomysły zostały przedstawione dla dwóch przypadków - jakości wyszukiwania w sieciach P2P oraz jakości usług strumieniowania wideo. W pomiarach postrzeganej jakości usług korzysta się z usług paneli użytkowników. Sposób wyznaczania ocen oraz zgodność w ich podejmowaniu umożliwiają takie narzędzia zaawansowanej statystyki matematycznej jak uogólnione modele liniowe (GLZ) oraz modele cech latentnych.

EN

Quality of Experience (QoE) is a concept extending a traditional Quality of Service approach. The difference is substantial as the QoE is intended to express a service user satisfaction while the QoS is limited to numerical evaluation of an underlying network performance. The study presents incentives for a quality of experience evaluation and several related approaches. Searching performance in P2P networks and video streaming quality are proposed as two cases studies for validation of QoE ideas. Measurements of a QoE level involve massive subjective experiments with a cooperation with experts. Statistical modelling of experts' behaviour and investigation of their agreement on rated objects calls for advanced statistical tools like a Generalized Linear Model (GLZ) or a latent structure model.

Słowa kluczowe

PL

usługi; jakość; QoE; sieci P2P; testy subiektywne

EN

QoE; quality; experience; P2P networks; subjective tests

• Wydawca: Wydawnictwo SIGMA-NOT
• Czasopismo: Przegląd Telekomunikacyjny + Wiadomości Telekomunikacyjne
• Rocznik: 2008
• Tom: R. 81, nr 4
• Strony: 142--153
• Opis fizyczny: Bibliogr. 60 poz., tab., wykr.

Twórcy

autor

Grega M.

autor

Janowski L.

autor

Leszczuk M.

autor

Romaniak P.

autor

Papir Z.

• Departament of Telecommunications, AGH University of Science and Technology, Krakow,

Bibliografia

• [1] Agresti A., CategoricalData Analysis, 2nd Edition, John Wiley & Sons, Ltd, 2002
• [2] Carli M. et al., Ouality Assessment Using Data Hiding on Perceptually ImportantAreas, IEEE International Conference on Image Processing, ICIP2005, September2005
• [3] Clement H. C. et al., Benchmarking for content-based visual information search. In Proceedings ofthe 4th International Conference on Ad-vances in Visual Information Systems, Springer-Verlag, 2000.
• [4] Dosselmann R., Yang X. D., A Prototype No-Reference Video Ouality System, Fourth Canadian Conference on Computer and Robot Vision, CRV 2007, vol. 2007, May
• [5] Eskicioglu A. M., Ouality Measurement for Monochrome Compressed Images in the Past 25 Years, in Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). Istan-bul, Turkey: IEEE, 2000
• [6] Eskicioglu A. M., Fisher P. S., Image Ouality Measures and Their Performance, IEEE Transactions on Communications, vol. 43, no. 12, De-cember 1995
• [7] Farias M., M itra S. K., No-Reference Video Ouality Metric Based on Ar-tefactMeasurements, IEEE International Conference on Image Processing, ICIP 2005, vol. 3, September 2005
• [8] Fleiss' kappa: Wikipedia, The Free Encyclopedia. 16 Nov 2007
• [9] Goodman D. J., Nash R. D., Subjective quallty of the same speech transmission conditions in seven differentcountries, IEEE Transactions on Communications, vol. com-30, No. 4,1982
• [10] Grega M. at al., Framework for Media Search Ouality Assessment, In: 6th International Workshop on Content-Based Multimedia lndexing CBMI2008,18-20th June, 2008, London, UK (under review)
• [11] Grega M. et al., Collaborative networking with trust and misbehaviour - a file sharing case. In OPCOM, Berlin, Germany, 2006
• [12] Grega M. et al., Compression and Distribution of Panoramie Images Concatenated using MPEG-7 Descriptors, In: Multimedia Toolsand Applications, Springer
• [13] Grega M. et al.: Content-basedsearch forpeer-to-peeroverlays. In: Proceedings of the Med-Hoc-Net '07, National & Kapodistrian University of Athens, Corfu, 2007
• [14] GregaM. et al.: Detecting panoramie image overlaps with MPEG-7descriptors. In: Proceedings ICSES '06, Technical University of Łódź, Vol. 1, Łódź, 2006
• [15] Grega M. et al., Ouality Evaluation of Compressed Panoramie Images Constructed using MPEG-7-Based Image Registration, In: 4th EURO-NGI Conference on Next Generation Internet Networks NGI2008, Kraków, Poland
• [16] He Y., Howasymmetric is Internetrouting? A systematic approach, ACM SIGCOMM, 2005
• [17] International Telecommunication Union, ITU Telecommunication standardization sector temporary document XX-E WP 2/12, information about a new method for derh/ing the transmission rating factor r from MOS in closed form, 2002, Geneva, Switzerland
• [18] International Telecommunication Union, Methodology for the subjecth/e assessment of the quality of television pictures, Recommendation ITU-R BT. 500 2002, Geneva, Switzerland
• [19] International Telecommunication Union. Methods forsubjeeth/e deter-mination of transmission quality, Recommendation ITU-T P. 800 1996, Geneva, Switzerland
• [20] International Telecommunication Union. The e-model, a computational model for usein transmission planning. Recommendation ITU-T G. 107, 2000, Geneva, Switzerland
• [21] IPTV Real-Time Video Ouality Testing, Spirent Communications, Inc., 2007, http: //www. spirenteom. com/documents/3942. pdf
• [22] Janowski L. etal,AutomatedQualitativeAssessmentotMulti-ModalDi-stortions in Digital Images Based on GLZ, In: 18* ITC Specialist Seminaron Ouality of Experience, May 2008, Blekinge Institute of Technology, Karlskrona, Sweden (under review)
• [23] Janowski L. et al., Automatic Assessment of User Experience for Images Affected by Multi-Modal Distortions, In: Computer Vision and Image Understanding, Elsevier (under review)
• [24] Janowski L. et al.: Objecie and subjectNe evaluation methods for se-lected aspects of fax image quality. In: New trends in audio and video, Ed. by Andrzej Dobrucki, Alexander Petrovsky, Wtadystaw Skarbek, Wydaw. Politechniki Biatostockiej, Białystok, 2006
• [25] Janowski L. et al.: Objective and subjective evaluation methods for se-lected aspects offax image quality. In: Proceedings ofthe AES '06, Audio AES, Białystok, 2006
• [26] Jia Y. et al., Estimating Just-Noticeable DistortJon for Video, IEEE Transactions on Circuits and Systems for Video Technology, vol. 16, no. 7, July 2006
• [27] KanumuriS.eXa\.,AGeneraHzedUnearModelforMPEG-2PacketLoss Yisibility, Packet Video Workshop, PV2004, December 2004
• [28] Lambrecht C. J. etal., Perceptual Ouality Measure Using a Spatio-Temporal Model of the Humań Visual System, in Proc. SPIE, vol. 2668,1996
• [29] Leszczuk M. et al.: Networked media of the futurę, Office for Official Pu-blications ofthe European Communities, Luxemburg, 2007
• [30] Leszczuk M. et al., User Centric Media - future and challenges in European research, Office for Official Publications ofthe European Communities, Luxemburg, 2007
• [31] Leszczuk M., Analiza możliwości budowy internetowych aplikacji dostępu do cyfrowych bibliotek wideo. Doctoral thesis, Katedra Telekomunikacji, Akademia Górniczo-Hutnicza im. Stanistawa Staszica w Krakowie, 2006
• [32] Leung C. H. C. et al. Benchmarking for content-based visual Information search. In Proceedings of the 41 International Conference on Advances in Visual Information Systems, Springer-Verlag, 2000
• [33] Lopez D. et al., Adaptive Multimedia Streaming over IP Based on Customer-Oriented Metrics, ISCN06 Bogazici Universrty, Bebek Campus, Istanbul. June 16 2006
• [34] Miller G. A.. The magical number seven, plus or minus two: Some limits on our capacity for processing information, Psychological Review, vol. 63. 1956
• [35] Nemertes Research The internet singularity, delayed: Why limits in internet capacity will stifle innovation on the web. „ White Paper, Novem-ber2007
• [36] Papir Z., Compression Evaluation of Surgery Video Recordings Retaining Diagnostic Credibility, Opto-Electronics Review (under review)
• [37] Parker A., Addressing the cost and performance challenges of digital media contentdelivery. In P2P Media Summit, Santa Monica, CA, Octo-ber2006
• [38] PEVQ Advanced Perceptual Evaluation of Video Ouality, OPTICOM, 2007, http: //www. opticom. de/download/PEVQ-WP-v07-A4. pdf
• [39] Romaniak P. et al„ Framework for the Irtegrated Video Ouality Asses-sment In: 78*" ITC Specialist Seminar on Ouality of Experience, May 29 - 30,2008, Blekinge Institute of Technology, Karlskrona, Sweden (under review)
• [40] Shengke Q. et al., No-Reference Perceptual Ouality Assessment for Streaming Video Based on Simple End-to-End Network Measures, International conference on Networking and Services, ICNS 2006, pp. 53-53,2006
• [41] Smith J. R. Image retrievalevaluation. In CBAIVL1998: Proceedings of the IEEE Workshop on Content - Based Access of Image and Video Libraries, page 112. Washington. DC. USA 1998
• [42] The E-Model, a Computational Model for Use in Transmission Planning, ITU-T, Geneva, Switzerland. March 2005
• [43] The Video Ouality Experts Group. VQEG. http: //www. vqeg. org/
• [44] Ubersax J., Statistical Methods for Tester Agreemerrt, http: //ourworld. compuserve. com/ homepages/jsuebersax/agree. htm99
• [45] Uebersax J., Modeling Approaches for the Analysis of Obsen/erAgreemerrt, lnvestigative Radiology, Vol. 17
• [46] Uebersax J., Statistical Modeling of Expert Ratings on Medical Appro-priateness, Journal of the American Statistical Association, June 1993, Vol. 88, No. 422
• [47] Uebersax J., Latent TraitModels for Tester Agreement, http: //ourworld. compuserve. com/ homepages/jsuebersax/ltrait. htm
• [48] Uebersax J.. private communication, February 2007
• [49] Verscheure O. et al., User-Oriented QoS Analysis in MPEG-2 Delh/ery, Journal ofReal-Time Imaging (special issue on Real-Time Digital Video over Multimedia Networks), vol. 5, no. 5, October 1999
• [50] Volmer T. et al., Modeling Humań Judgmentof Digital Imageiy for Multimedia Retrievat, IEEE Trans. Multimedia, August 2007, Vol. 9, No. 5
• [51] Wang Y. et al., A Latent C/ass Modeling Approach to Detect Network Intrusion, Computer Communications, Vol. 30, December 2006
• [52] Wang Y.: Survey of Objective Video Ouality Measurements. Technical report, EMC Corporation Hopkinton, 2006
• [53] Wang Z et al., Video Ouality Assessment Based on Structural Distor-tion Measurement, Signal Processing: Image Communication, vol. 19, no. 2, 2004
• [54] Wang Z. et al., Image Ouality Assessment: From Error Visibility to Structural Similarity, IEEE Transactions on Image Processing, vol. 13, no. 4,April 2004
• [55] Wang Z., Objective ImageMdeo Ouality Measurement a Literaturę Survey, EE 381K: Multidimensional Digital Signal Processin.
• [56] Watson A., Sasse M. A, Measuring Perceived Ouality of Speech and Video in Multimedia Conferencing Applications, ACM Multimedia, 1998
• [57] Winkler S., A Perceptual Distortion Metric for Digital Colour Video, in Proc. SP/E, vol. 3644,1999
• [58] Winkler S., Mideo Ouality and Beyond, in Proc. European Signal Processing Conference, Poznań, Poland, September 3-7 2007
• [59] Winkler S., Digital Video Ouality- Vision Models andMetrics, John Wiley & Sons, Ltd, 2005
• [60] Wolf S. et al., Spatial-Temporal Distortion Metrics for ln-Service Ouality Monitoring ofAny Digital Video System, in Proc. SPIE, vol. 3845,1999