Audiovisual Quality Assessment: A Study of Video Calls Provided by Social Media Applications
DOI: 10.14416/j.ind.tech.2020.03.003
Keywords:
Audiovisual; Video Call, Social Media Application, QoE; MOS, Subjective MethodAbstract
This study presents a comparative study about audiovisual quality from Facebook Messenger, WhatsApp, and LINE when using them specifically to make video calls from smartphones. The first part of this study is based on subjective tests. After gathering the results, audiovisual quality from each social media application has been calculated before conducting statistical analysis. From the results and analysis, it has been found that Messenger can provide slightly better audiovisual quality with Mean Opinion Score (MOS) of 4.02-4.10 than WhatsApp and LINE with MOS of 3.75-3.85 and 3.63-3.90 respectively, although there is no significant difference after testing the hypotheses by using Analysis of Variance (ANOVA) technique. Besides, this study has shown that the Hands’ additive linear model and the Belmudez & Moller’s full model are reliable to be utilized for short conversation - audiovisual quality assessment, which is one of the contributions of this study.
References
[1] www.statista.com/statistics/203734/globalsmartphone-penetration-per-capita-since-2005 (Accessed on 20 January 2020)
[2] www.dreamgrow.com/top-15-most-popular-social-networking-sites/ (Accessed on 20 January 2020)
[3] S. Jana, A. Pande, A. Chan and P. Mohapatra, Mobile video chat: Issues and Challenges, IEEE Communications Magazine, 2013, 51, 144 – 151.
[4] I. Saidi, L. Zhang, V. Barriac and O. Deforges, Audiovisual Quality Study for Videoconferencing on IP Networks, IEEE Workshop on Multimedia Signal Processing (MMSP 2016), 2016. DOI: 10.1109/MMSP.2016.781337.
[5] K. Yamagishi, T. Tominaga, T. Hayashi and A. Takahashi, Objective Quality Evaluation Model for Videophone Services, NTT Technical Review, 2007, 5(6), 1 – 5.
[6] T. Daengsi and P. Pornpongtechavanich, Comparison of Video Call Quality from Social Media Applications: Messenger vs LINE, The International Conference on Science, Technology and Innovation for Sustainable Well-Being (STISWB 2019), Proceeding, 2019, 578 – 583.
[7] P. Zou, H. Li, W. Wang, C. Xin, and B. Zhu, Finding Disjoint Dense Clubs in a Social Network, Theoretical Computer Science, 2018, 734, 15 – 23.
[8] Md.O. Faruq, A. Al-Reza, Md. M. Rahman, and M.R. Alam, Impact of Social Networking Sites in Bangladesh: Few Possible Solutions, International Journal of Intelligent Systems and Applications, 2017, 9(4), 53 – 60.
[9] www.whatsapp.com/about/?lang=en (Accessed on 20 January 2020)
[10] https://crambler.com/truth-about-facebook-messenger-app-privacy (Accessed on 20 January 2020)
[11] www.webwise.ie/parents/explained-what-is-messenger (Accessed on 20 January 2020)
[12] https://play.google. com/store/apps/details?id=com.facebook.orca&hl=en (Accessed on 20 January 2020)
[13] https://itunes.apple.com/us/app/messenger/id454638411 (Accessed on 20 January 2020)
[14] www. businessinsider.com/history-of-line-japan-app-2014-1 (Accessed on 20 January 2020)
[15] P. Wuttidittachotti and T. Daengsi, Quality Evaluation of Mobile Networks Using VoIP Applications: A Case Study with Skype and LINE based-on Stationary Tests in Bangkok, International Journal of Computer Network and Information Security, 2015, 7(12), 28 – 41.
[16] www.pressreader.com/thailand/Bangkok-post/20170321/281925952832752 (Accessed on 20 January 2020)
[17] P. Calyam and C. Lee, Characterizing Voice and Video Traffic Behaviour Over the Internet, The 20th International Symposium on Computer and Information Sciences (ISCIS'05), 2005, 91 – 95.
[18] A. Khan, L. Sun, E. Jammeh and E. Ifeachor, Quality of Experience-Driven Adaptation Scheme for Video Applications Over Wireless Networks, IET Communications, 2010, 4(11), 1337 – 1347.
[19] B. Jia, L. Hao, C. Zhang, Zhang, H. Zhang and M. Khan, An IoT Service Aggregation Method Based on Dynamic Planning for QoE Restraints, Mobile Networks and Applications, 2019, 24, 25 – 33.
[20] H. Batteram, G. Damm, A. Mukhopadhyay, L. Philippart, R. Odysseos, and C. Urrutia-Valdés, Delivering quality of experience in multimedia networks, Bell Labs Technical Journal, 2010, 15(1), 175 – 193.
[21] ITU-T Recommendation P.800, Methods for Subjective Determination of Transmission Quality, 1996.
[22] P. Wuttidittachotti, P. Khaoduang and T. Daengsi, MOS Eestimation Model Development using ACR Listening-Opinion Tests with Thai Users Referring to Loss Effects: A Case of G.726 and G.729”, Multimedia Systems, 2018, 24(3), 285 – 295.
[23] T. Zinner, O. Abboud, O. Hohlfeld, T. Hossfeld and P. Tran-Gia, Towards QoE Management for Scalable Video Streaming, The 21st ITC Specialist Seminar on Multimedia Applications - Traffic, Performance and QoE (ITC-SS21), 2010, 64 – 69.
[24] M. Piriyakul, Analysis of Moderation Effects Through PROCESS, The Journal of Industrial Technology, 2019, 15(2), 144 – 161.
[25] K. Songsorn, K. Sriprateep and S. Rittidechhttp, Optimization of Metal Inert Gas Pulse Brazing Process on Galvanized Steel Sheets Based on Taguchi Method, The Journal of Industrial Technology, 2017, 13(2), 78 – 95.
[26] ITU-T Recommendation G.1070, Opinion Model for Video-Telephony Applications, 2018.
[27] D. S. Hands, A Basic Multimedia Quality Model, IEEE Transactions on Multimedia, 2004, 6(6), 806 – 816.
[28] S. Winkler and C. Faller, Perceived Audiovisual Quality of Low-Bitrate Multimedia Content, IEEE Transactions on Multimedia, 2006, 8(5), 973 – 980.
[29] B. Belmudez and S. Möller, Audiovisual Quality Integration for Interactive Communications, EURASIP Journal on Audio Speech and Music Processing, 2013, Article No. 2013: 24, 1 – 23.
[30] P. Wuttidittachotti and T. Daengsi, Subjective MOS Model and Simplified E-Model Enhancement for Skype Associated with Packet Loss Effects: A Case Using Conversation-like Tests with Thai Users, Multimedia Tools and Applications, 2017, 76(15), 16163 – 16187.
[31] ITU-T Recommendation P.805, Subjective Evaluation of Conversational Quality, 2007.
[32] https://www.glasswire.com/?os=win (Accessed on 23 August 2018)
[33] M. Matulin and Š. Mrvelj, Modelling User Quality of Experience from Objective and Subjective Data Sets Using Fuzzy Logic, Multimedia Systems, 2018, 24, 645 – 667.
[2] www.dreamgrow.com/top-15-most-popular-social-networking-sites/ (Accessed on 20 January 2020)
[3] S. Jana, A. Pande, A. Chan and P. Mohapatra, Mobile video chat: Issues and Challenges, IEEE Communications Magazine, 2013, 51, 144 – 151.
[4] I. Saidi, L. Zhang, V. Barriac and O. Deforges, Audiovisual Quality Study for Videoconferencing on IP Networks, IEEE Workshop on Multimedia Signal Processing (MMSP 2016), 2016. DOI: 10.1109/MMSP.2016.781337.
[5] K. Yamagishi, T. Tominaga, T. Hayashi and A. Takahashi, Objective Quality Evaluation Model for Videophone Services, NTT Technical Review, 2007, 5(6), 1 – 5.
[6] T. Daengsi and P. Pornpongtechavanich, Comparison of Video Call Quality from Social Media Applications: Messenger vs LINE, The International Conference on Science, Technology and Innovation for Sustainable Well-Being (STISWB 2019), Proceeding, 2019, 578 – 583.
[7] P. Zou, H. Li, W. Wang, C. Xin, and B. Zhu, Finding Disjoint Dense Clubs in a Social Network, Theoretical Computer Science, 2018, 734, 15 – 23.
[8] Md.O. Faruq, A. Al-Reza, Md. M. Rahman, and M.R. Alam, Impact of Social Networking Sites in Bangladesh: Few Possible Solutions, International Journal of Intelligent Systems and Applications, 2017, 9(4), 53 – 60.
[9] www.whatsapp.com/about/?lang=en (Accessed on 20 January 2020)
[10] https://crambler.com/truth-about-facebook-messenger-app-privacy (Accessed on 20 January 2020)
[11] www.webwise.ie/parents/explained-what-is-messenger (Accessed on 20 January 2020)
[12] https://play.google. com/store/apps/details?id=com.facebook.orca&hl=en (Accessed on 20 January 2020)
[13] https://itunes.apple.com/us/app/messenger/id454638411 (Accessed on 20 January 2020)
[14] www. businessinsider.com/history-of-line-japan-app-2014-1 (Accessed on 20 January 2020)
[15] P. Wuttidittachotti and T. Daengsi, Quality Evaluation of Mobile Networks Using VoIP Applications: A Case Study with Skype and LINE based-on Stationary Tests in Bangkok, International Journal of Computer Network and Information Security, 2015, 7(12), 28 – 41.
[16] www.pressreader.com/thailand/Bangkok-post/20170321/281925952832752 (Accessed on 20 January 2020)
[17] P. Calyam and C. Lee, Characterizing Voice and Video Traffic Behaviour Over the Internet, The 20th International Symposium on Computer and Information Sciences (ISCIS'05), 2005, 91 – 95.
[18] A. Khan, L. Sun, E. Jammeh and E. Ifeachor, Quality of Experience-Driven Adaptation Scheme for Video Applications Over Wireless Networks, IET Communications, 2010, 4(11), 1337 – 1347.
[19] B. Jia, L. Hao, C. Zhang, Zhang, H. Zhang and M. Khan, An IoT Service Aggregation Method Based on Dynamic Planning for QoE Restraints, Mobile Networks and Applications, 2019, 24, 25 – 33.
[20] H. Batteram, G. Damm, A. Mukhopadhyay, L. Philippart, R. Odysseos, and C. Urrutia-Valdés, Delivering quality of experience in multimedia networks, Bell Labs Technical Journal, 2010, 15(1), 175 – 193.
[21] ITU-T Recommendation P.800, Methods for Subjective Determination of Transmission Quality, 1996.
[22] P. Wuttidittachotti, P. Khaoduang and T. Daengsi, MOS Eestimation Model Development using ACR Listening-Opinion Tests with Thai Users Referring to Loss Effects: A Case of G.726 and G.729”, Multimedia Systems, 2018, 24(3), 285 – 295.
[23] T. Zinner, O. Abboud, O. Hohlfeld, T. Hossfeld and P. Tran-Gia, Towards QoE Management for Scalable Video Streaming, The 21st ITC Specialist Seminar on Multimedia Applications - Traffic, Performance and QoE (ITC-SS21), 2010, 64 – 69.
[24] M. Piriyakul, Analysis of Moderation Effects Through PROCESS, The Journal of Industrial Technology, 2019, 15(2), 144 – 161.
[25] K. Songsorn, K. Sriprateep and S. Rittidechhttp, Optimization of Metal Inert Gas Pulse Brazing Process on Galvanized Steel Sheets Based on Taguchi Method, The Journal of Industrial Technology, 2017, 13(2), 78 – 95.
[26] ITU-T Recommendation G.1070, Opinion Model for Video-Telephony Applications, 2018.
[27] D. S. Hands, A Basic Multimedia Quality Model, IEEE Transactions on Multimedia, 2004, 6(6), 806 – 816.
[28] S. Winkler and C. Faller, Perceived Audiovisual Quality of Low-Bitrate Multimedia Content, IEEE Transactions on Multimedia, 2006, 8(5), 973 – 980.
[29] B. Belmudez and S. Möller, Audiovisual Quality Integration for Interactive Communications, EURASIP Journal on Audio Speech and Music Processing, 2013, Article No. 2013: 24, 1 – 23.
[30] P. Wuttidittachotti and T. Daengsi, Subjective MOS Model and Simplified E-Model Enhancement for Skype Associated with Packet Loss Effects: A Case Using Conversation-like Tests with Thai Users, Multimedia Tools and Applications, 2017, 76(15), 16163 – 16187.
[31] ITU-T Recommendation P.805, Subjective Evaluation of Conversational Quality, 2007.
[32] https://www.glasswire.com/?os=win (Accessed on 23 August 2018)
[33] M. Matulin and Š. Mrvelj, Modelling User Quality of Experience from Objective and Subjective Data Sets Using Fuzzy Logic, Multimedia Systems, 2018, 24, 645 – 667.
Downloads
Published
2020-03-20
Issue
Section
บทความวิจัย (Research article)
