Coding and transmission
I-Lab has an extensive research background on multiple aspects of 2D and 3D video coding and transmission. The research outputs yielded through a series of collaborative European research projects focussed on networked media aspects, such as capturing, processing, coding, transmission, adaptation and presentation of rich audio visual media have paved the way to significantly contributing to the international research community.
Among the most significant areas of the expertise are novel coding schemes applied to stereoscopic and multi-view videos that are based on widely deployed international coding standards, such as H.264/MPEG-4 AVC, Scalable Video Coding extension (SVC) and Multi-View Coding (MVC). Contributions include the advancement in the error robustness schemes of existing encoders, making use of the statistical dependencies between different elements of 3D media.
I-Lab has also contributed towards the development of novel cross layer design for 3D video transmission over wireless broadband access networks (such as WIMAX and WLAN). Relative perceptual importance of different layers of the 3D videos is made use of in assigning different error protection levels in the wireless transmission channel. On the other hand, significant research contributions have been done in the processing side.
These contributions are focussed on the statistical improvements in the depth maps aiming at maximising the perceptual quality of output 3D video.
The works have resulted in a number of publications in prestigious transactions as well as contributions in international standards in the form of recommendation. Analysis works are being carried out on the Quality of Experience for 3D media. Recent research work is concentrated on the deployment of highly flexible, scalable rich multi-view video dissemination mechanism utilising popular P2P multicast scheme.
Existing standards, such as SVC, are utilised to supply means of backwards compatible solution for legacy 3D-TV systems in bandwidth constrained environment, whereas the bulk of 3D media is delivered using error robust communication mechanisms, such as multiple description coding. In addition, novel side information is delivered to increase the network adaptation performance.
Visual attention in 3D media is also utilised in different ways in the 3D-TV chain to contribute towards an improved QoE. This includes the utilisation of visual attention information in content-aware terminal adaptation, as well as Region-of-Interest adaptive scalable video coding.
De Silva, D.V.S.X.; Ekmekcioglu, E.; Fernando, W.A.C.; Worrall, S.T.; , "Display Dependent Preprocessing of Depth Maps Based on Just Noticeable Depth Difference Modeling," Selected Topics in Signal Processing, IEEE Journal of , vol.5, no.2, pp.335-351, April 2011
Ekmekcioglu, E.; Velisavljević, V.; Worrall, S.T.; , "Content Adaptive Enhancement of Multi-View Depth Maps for Free Viewpoint Video," Selected Topics in Signal Processing, IEEE Journal of , vol.5, no.2, pp.352-361, April 2011
D. V. S. X. De Silva, W. A. C. Fernando, S.T.Worrall, H. Kodikara Arachchi and A.M. Kondoz, "Sensitivity Analysis of the Human Visual System for Depth Cues in Stereoscopic 3D Displays," IEEE Transactions on Multimedia, vol. 13, no. 3, June 2011
Savas, S. S.; Gurler, C. G.; Tekalp, A. M.; Ekmekcioglu, E.; Worrall, S. T.; Kondoz, A. M., “Adaptive Streaming of Multi-View Video over P2P Networks,” Elsevier Journal Signal Processing: Image Communication (Special Issue on Advances in video streaming for P2P networks), accepted for publication
E. Ekmekcioglu, S. Worrall, V. Velisavljevic, D. De Silva, A. Kondoz, “Multi-view Depth pre-processing using joint filtering for improved coding performance”, ISO MPEG Doc No. m20070, March 2011, Geneva
E. Ekmekcioglu, S. Worrall, H. KodikaraArachchi, S. Dogan, B. Gunel, A. Kondoz, “New Multi-view Test Sequences and Camera Parameters for 3DV Standardisation Work”, MPEG Doc No. m20068, March 2011, Geneva