Scientific Exchange Programme

Full title

Scientific Exchange Programme NMS-CH project 09.040 – Compression of Holographic Visual Information (CHVI)

Duration of project

September 2010 – April 2012

Funding source

Scientific Exchange Programme NMSCH

Description

While 3D display technologies are already widely available for cinema and home or corporate use, only a few portable devices currently feature 3D display capabilities. Moreover, the large majority of 3D display solutions rely on binocular perception. This project aims the alternative methods for restitution of 3D images on conventional 2D displays and analyses their respective performance.

The core of the project deals on the processing of the holographic visual information with special focus on algorithms for display/presentation techniques based on holographic principles. The combination of binocular (stereoscopy) and monocular (motion parallax) cues are investigated in order to perceive the 3D visual information in a more realistic manner when compared to the state of the art. This particularly includes the extension of wiggle stereoscopy which relies on motion parallax as an additional depth cue.

Research activities

  • Depth estimation and view synthesis algorithms
  • Multi-view visual information coding
  • Android applications development
  • Stereo to multi-view conversion
  • Quality assessment
A.-F. N. M. Perrin : Context-based Quality of Experience in Immersive Multimedia. Lausanne, EPFL, 2019. DOI : 10.5075/epfl-thesis-7272.
A. Perrin; M. Rerabek; W. Husak; T. Ebrahimi : ICtCp Versus Y'CbCr; IEEE CONSUMER ELECTRONICS MAGAZINE. 2018. DOI : 10.1109/MCE.0017.2714696.
A.-F. N. M. Perrin; M. Rerabek; W. Husak; T. Ebrahimi : Quality assessment of an HDR dual-layer backward-compatible codec compared to uncompromised SDR and HDR solutions; IEEE transaction on broadcasting, special issue on Quality of Experience for advanced broadcast services. 2018. DOI : 10.1109/TBC.2018.2823913.
A.-F. N. M. Perrin; M. Rerabek; W. Husak; T. Ebrahimi : Evaluation of ICtCp color space and an Adaptive Reshaper for HDR and WCG; IEEE CONSUMER ELECTRONICS MAGAZINE. 2018. DOI : 10.1109/MCE.2017.2714696.
I. Viola; M. Rerabek; T. Ebrahimi : Comparison and evaluation of light field image coding approaches; IEEE Journal of Selected Topics in Signal Processing. 2017. DOI : 10.1109/JSTSP.2017.2740167.
I. Viola; M. Rerabek; T. Ebrahimi : Impact of interactivity on the assessment of quality of experience for light field content. 2017. 9th International Conference on Quality of Multimedia Experience (QoMEX), Erfurt, Germany, May 31 - June 02, 2017. DOI : 10.1109/QoMEX.2017.7965636.
E. Upenik; M. Rerabek; T. Ebrahimi : On the performance of objective metrics for omnidirectional visual content. 2017. 9th International Conference on Quality of Multimedia Experience (QoMEX 2017), Erfurt, Germany, May 31 – June 2, 2017. DOI : 10.1109/QoMEX.2017.7965660.
I. Viola; M. Rerabek; T. Bruylants; P. Schelkens; F. Pereira et al. : Objective and subjective evaluation of light field image compression algorithms. 2016. 32nd Picture Coding Symposium, Nuremberg, Germany, December 4-7, 2016. DOI : 10.1109/PCS.2016.7906379.
I. Viola; M. Rerabek; T. Ebrahimi : A new approach to subjectively assess quality of plenoptic content. 2016. SPIE Optical Engineering + Applications, San Diego, California, USA, August 28 - September 1, 2016. p. 99710X-1-99710X-13. DOI : 10.1117/12.2240279.
M. Rerabek; E. Upenik; T. Ebrahimi : JPEG backward compatible coding of omnidirectional images. 2016. SPIE Optics + Photonics, San Diego, California, USA, August 28 - September 1, 2016. p. 99711O-1-99711O-12. DOI : 10.1117/12.2240281.
E. Upenik; M. Rerabek; T. Ebrahimi : Testbed for subjective evaluation of omnidirectional visual content. 2016. 32nd Picture Coding Symposium (PCS), Nuremberg, Germany, December 4-7, 2016. DOI : 10.1109/PCS.2016.7906378.
M. Rerabek; T. Ebrahimi : New Light Field Image Dataset. 2016. 8th International Conference on Quality of Multimedia Experience (QoMEX), Lisbon, Portugal, June 6-8, 2016.
P. Hanhart; M. Rerabek; T. Ebrahimi : Subjective and Objective Evaluation of HDR Video Coding Technologies. 2016. 8th International Conference on Quality of Multimedia Experience (QoMEX), Lisbon, Portugal, June 6-8, 2016. DOI : 10.1109/QoMEX.2016.7498943.
M. Rerabek; P. Hanhart; T. Ebrahimi : [JCT-VC contribution] HDR CE3: Results of subjective evaluations conducted with the DSIS method. 2016.
A.-F. N. M. Perrin; M. Rerabek; T. Ebrahimi : Towards prediction of Sense of Presence in immersive audiovisual communications. 2016. Human Vision and Electronic Imaging (HVEI) 2016, San Francisco, February 14-18, 2016. DOI : 10.2352/ISSN.2470-1173.2016.16.HVEI-128.
E. Kroupi; P. Hanhart; J.-S. Lee; M. Rerabek; T. Ebrahimi : Modeling Immersive Media Experiences by Sensing Impact on Subjects; Multimedia Tools and Applications. 2015. DOI : 10.1007/s11042-015-2980-z.
P. Hanhart; M. Rerabek; T. Ebrahimi : Towards high dynamic range extensions of HEVC: subjective evaluation of potential coding technologies. 2015. SPIE Optical Engineering + Applications, San Diego, California, USA, August 10-13, 2015. p. 95990G. DOI : 10.1117/12.2193832.
A.-F. N. M. Perrin; H. Xu; E. Kroupi; M. Rerabek; T. Ebrahimi : Multimodal Dataset for Assessment of Quality of Experience in Immersive Multimedia. 2015. ACMMULTIMEDIA 2015 (ACM MM), Brisbane, Australia, October 26-30, 2015. DOI : 10.1145/2733373.2806387.
M. Rerabek; L. Yuan; L. A. Authier; T. Ebrahimi : [ISO/IEC JTC 1/SC 29/WG1 contribution] EPFL Light-Field Image Dataset. 2015.
P. Hanhart; M. Rerabek; T. Ebrahimi : [ISO/IEC MPEG contribution] Results of HDR CfE subjective evaluations conducted at EPFL. 2015.
M. Rerabek; P. Hanhart; P. Korshunov; T. Ebrahimi : Quality Evaluation of HEVC and VP9 Video Compression in Real-Time Applications. 2015. 7th International Workshop on Quality of Multimedia Experience (QoMEX), Costa Navarino, Messinia, Greece, May 26-29, 2015.
M. Rerabek; P. Hanhart; P. Korshunov; T. Ebrahimi : Subjective and objective evaluation of HDR video compression. 2015. 9th International Workshop on Video Processing and Quality Metrics for Consumer Electronics (VPQM), Chandler, Arizona, USA, February 5-6, 2015.
M. Rerabek; P. Korshunov; P. Hanhart; T. Ebrahimi : [ISO/IEC MPEG contribution] Correlation of subjective scores and objective metrics for HDR video quality assessment. 2014.
M. Rerabek; L. Yuan; L. Krasula; P. Korshunov; K. Fliegel et al. : Evaluation of privacy in high dynamic range video sequences. 2014. SPIE Optical Engineering + Applications, San Diego, California, USA, August 18-21, 2014. DOI : 10.1117/12.2065559.
M. Rerabek; T. Ebrahimi : Comparison of compression efficiency between HEVC/H.265 and VP9 based on subjective assessments. 2014. SPIE Optical Engineering + Applications, San Diego, California, USA, August 18-21, 2014. DOI : 10.1117/12.2065561.
E. Kroupi; P. Hanhart; J.-S. Lee; M. Rerabek; T. Ebrahimi : EEG correlates during video quality perception. 2014. 22nd European Signal Processing Conference (EUSIPCO), Lisbon, Portugal, September 1-5, 2014.
E. Kroupi; P. Hanhart; J.-S. Lee; M. Rerabek; T. Ebrahimi : Predicting Subjective Sensation of Reality During Multimedia Consumption Based on EEG and Peripheral Physiological Signals. 2014. IEEE International Conference on Multimedia and Expo (ICME), Chengdu, China, July 14-18, 2014.
M. Rerabek; T. Ebrahimi : A new database of still and moving High Dynamic Range pictures. 2014. HDRi2014 -Second International Conference and SME Workshop on HDR imaging, Sarajevo, Bosnia and Herzegovina,, March 04-05, 2014.
M. Rerabek; H. Nemoto; J.-S. Lee; T. Ebrahimi : Audiovisual focus of attention and its application to Ultra High Definition video compression. 2014. SPIE electronic Imaging, San Francisco, California, USA, February 02, 2014. DOI : 10.1117/12.2047850.
E. Kroupi; P. Hanhart; J.-S. Lee; M. Rerabek; T. Ebrahimi : USER-INDEPENDENT CLASSIFICATION OF 2D VERSUS 3D MULTIMEDIA EXPERIENCES THROUGH EEG AND PHYSIOLOGICAL SIGNALS. 2014. 8th International Workshop on Video Processing and Quality Metrics for Consumer Electronics - VPQM 2014, Chandler, Arizona, USA, January 30-31, 2014.
A. Chappuis; M. Rerabek; P. Hanhart; T. Ebrahimi : Subjective evaluation of an active crosstalk reduction system for mobile autostereoscopic displays. 2014. SPIE Electronic Imaging, San Francisco, California, USA, February 2-6, 2014. DOI : 10.1117/12.2040391.
P. Hanhart; P. Korshunov; M. Rerabek; T. Ebrahimi : JPEG backward compatible format for 3D content representation. 2013. 14th International Workshop on Image and Audio Analysis for Multimedia Interactive Services, Paris, France, July 3-5, 2013. DOI : 10.1109/WIAMIS.2013.6616156.
P. Hanhart; M. Rerabek; I. Ivanov; A. Dufaux; C. Jones et al. : Automatic defect detection in video archives - Application to Montreux Jazz Festival Digital Archives. 2013. SPIE Optical Engineering + Applications, San Diego, California, USA, August 25-29, 2013. DOI : 10.1117/12.2026875.
P. Hanhart; M. Rerabek; P. Korshunov; T. Ebrahimi : [JCT-VC contribution] AhG4: Subjective evaluation of HEVC intra coding for still image compression. 2013.
P. Hanhart; M. Rerabek; P. Korshunov; T. Ebrahimi : Subjective evaluation of HEVC intra coding for still image compression. 2013. Seventh International Workshop on Video Processing and Quality Metrics for Consumer Electronics - VPQM 2013, Scottsdale, Arizona, USA, January 30 - February 1, 2013.
P. Hanhart; F. De Simone; M. Rerabek; T. Ebrahimi : 3D Video Quality Assessment; Emerging Technologies for 3D Video: Creation, Coding, Transmission and Rendering; John Wiley & Sons Inc, 2013. p. 378-393.
P. Hanhart; M. Rerabek; F. De Simone; T. Ebrahimi : Subjective quality evaluation of the upcoming HEVC video compression standard. 2012. SPIE Optical Engineering + Applications, San Diego, California, USA, August 13-16, 2012. DOI : 10.1117/12.946036.
M. Rerabek; T. Ebrahimi : COMPARISON OF 3D PORTABLE DISPLAY RESTITUTION TECHNIQUES BASED ON STEREO AND MOTION PARALLAX. 2012. QoMEX 2012, Yarra Valley, 5-7 July 2012.
P. Hanhart; F. De Simone; M. Rerabek; T. Ebrahimi : [ISO/IEC MPEG contribution] 3DV: Objective quality measurement for the 2-view case scenario. 2012.
A. Perkis; J. You; L. Xing; T. Ebrahimi; F. De Simone et al. : Towards certification of 3D video quality assessment. 2012. 6th International Workshop on Video Processing and Quality Metrics for Consumer Electronics - VPQM 2012, Scottsdale, Arizona, USA, January 19-20, 2012.
M. Rerabek; L. Goldmann; J. S. Lee; T. Ebrahimi : Motion Parallax Based Restitution of 3D Images on Legacy Consumer Mobile Devices. 2011. 13th international workshop on multimedia signal processing, Hangzhou, China, October 17-19, 2011.