A paper entitled “Improving Interactive TV Experience Using Second Screen Mobile Applications” is to appear in IEEE International Symposium on Multimedia (IEEE ISM), Miami, Florida | December 14-16.
The past two decades have seen a shift in the multimedia consumption behaviours from that of collectivism and passivity, to individualism and activity. This paper introduces the architectural design, implementation and user evaluation of a second screen application, which is designed to supersede the traditional user control interface for primary screen interaction. We describe how NSMobile, our second screen application, can be used as a pervasive multimedia platform by integrating user experiences on both the second screen and primary screen. The quantitative and qualitative evaluation of user interactions with interactive TV content also contributes to the future design of second screen applications.
A full paper entitled “QoE-aware Inter-stream Synchronization in Open N-Screens Cloud” has been accepted by the the QoE and Human-Centered Communications and Application track of IEEE Consumer Communications & Networking Conference (CCNC), Las Vegas, January 9-12, 2016. The conference is held in conjunction with the International Consumer Electronics Show (CES).
I am also a PC member of the Cloud Services and Networking track of the same conference.
The growing popularity and increasing performance of mobile devices is transforming the way in which media can be consumed, from single device playback to orchestrated multi-stream experiences across multiple devices. One of the biggest challenges in realizing such immersive media experience is the dynamic management of synchronicity between associated media streams. This is further complicated by the faceted aspects of user perception and heterogeneity of user devices and networks. This paper introduces a QoE-aware open inter-stream media synchronization framework (IMSync). IMSync employs efficient monitoring and control mechanisms, as well as a bespoke QoE impact model derived from subjective user experiments. The impact model balances the accumulative impact of re-synchronization processes and the degree of non-synchronicity to ensure the QoE. Experimental results verify the run-time performance of the framework as a foundation for immersive media experience in open N-Screens cloud.