Scientific Exchange Programme

Full title

Scientific Exchange Programme NMS-CH project 09.040 – Compression of Holographic Visual Information (CHVI)

Duration of project

September 2010 – April 2012

Funding source

Scientific Exchange Programme NMSCH

Description

While 3D display technologies are already widely available for cinema and home or corporate use, only a few portable devices currently feature 3D display capabilities. Moreover, the large majority of 3D display solutions rely on binocular perception. This project aims the alternative methods for restitution of 3D images on conventional 2D displays and analyses their respective performance.

The core of the project deals on the processing of the holographic visual information with special focus on algorithms for display/presentation techniques based on holographic principles. The combination of binocular (stereoscopy) and monocular (motion parallax) cues are investigated in order to perceive the 3D visual information in a more realistic manner when compared to the state of the art. This particularly includes the extension of wiggle stereoscopy which relies on motion parallax as an additional depth cue.

Research activities

  • Depth estimation and view synthesis algorithms
  • Multi-view visual information coding
  • Android applications development
  • Stereo to multi-view conversion
  • Quality assessment

References

 

Events

SCIEX fellows meeting

 

Image Compression and Quality Assessment using Convolutional Neural Networks

P. Akyazi / T. Ebrahimi (Dir.)  

Lausanne, EPFL, 2020. 

Context-based Quality of Experience in Immersive Multimedia

A-F. N. M. Perrin / T. Ebrahimi (Dir.)  

Lausanne, EPFL, 2019. 

ICtCp Versus Y’CbCr

A. Perrin; M. Rerabek; W. Husak; T. Ebrahimi 

IEEE CONSUMER ELECTRONICS MAGAZINE. 2018. Vol. 7, num. 3, p. 38-47. DOI : 10.1109/MCE.0017.2714696.

Quality assessment of an HDR dual-layer backward-compatible codec compared to uncompromised SDR and HDR solutions

A-F. N. M. Perrin; M. Rerabek; W. Husak; T. Ebrahimi 

IEEE Transactions on Broadcasting. 2018. Vol. 64, num. 2, p. 422-431. DOI : 10.1109/TBC.2018.2823913.

Evaluation of ICtCp color space and an Adaptive Reshaper for HDR and WCG

A-F. N. M. Perrin; M. Rerabek; W. Husak; T. Ebrahimi 

IEEE CONSUMER ELECTRONICS MAGAZINE. 2018. Vol. 7, num. 3, p. 38-47. DOI : 10.1109/MCE.2017.2714696.

Comparison and evaluation of light field image coding approaches

I. Viola; M. Rerabek; T. Ebrahimi 

IEEE Journal of Selected Topics in Signal Processing. 2017. Vol. 11, num. 7, p. 1092-1106. DOI : 10.1109/JSTSP.2017.2740167.

Impact of interactivity on the assessment of quality of experience for light field content

I. Viola; M. Rerabek; T. Ebrahimi 

2017. 9th International Conference on Quality of Multimedia Experience (QoMEX), Erfurt, Germany, May 31 – June 02, 2017. DOI : 10.1109/QoMEX.2017.7965636.

On the performance of objective metrics for omnidirectional visual content

E. Upenik; M. Rerabek; T. Ebrahimi 

2017. 9th International Conference on Quality of Multimedia Experience (QoMEX 2017), Erfurt, Germany, May 31 – June 2, 2017. DOI : 10.1109/QoMEX.2017.7965660.

Objective and subjective evaluation of light field image compression algorithms

I. Viola; M. Rerabek; T. Bruylants; P. Schelkens; F. Pereira et al. 

2016. 32nd Picture Coding Symposium, Nuremberg, Germany, December 4-7, 2016. DOI : 10.1109/PCS.2016.7906379.

A new approach to subjectively assess quality of plenoptic content

I. Viola; M. Rerabek; T. Ebrahimi 

2016. SPIE Optical Engineering + Applications, San Diego, California, USA, August 28 – September 1, 2016. p. 99710X-1-99710X-13. DOI : 10.1117/12.2240279.

JPEG backward compatible coding of omnidirectional images

M. Rerabek; E. Upenik; T. Ebrahimi 

2016. SPIE Optics + Photonics, San Diego, California, USA, August 28 – September 1, 2016. p. 99711O-1-99711O-12. DOI : 10.1117/12.2240281.

Testbed for subjective evaluation of omnidirectional visual content

E. Upenik; M. Rerabek; T. Ebrahimi 

2016. 32nd Picture Coding Symposium (PCS), Nuremberg, Germany, December 4-7, 2016. DOI : 10.1109/PCS.2016.7906378.

New Light Field Image Dataset

M. Rerabek; T. Ebrahimi 

2016. 8th International Conference on Quality of Multimedia Experience (QoMEX), Lisbon, Portugal, June 6-8, 2016.

Subjective and Objective Evaluation of HDR Video Coding Technologies

P. Hanhart; M. Rerabek; T. Ebrahimi 

2016. 8th International Conference on Quality of Multimedia Experience (QoMEX), Lisbon, Portugal, June 6-8, 2016. DOI : 10.1109/QoMEX.2016.7498943.

[JCT-VC contribution] HDR CE3: Results of subjective evaluations conducted with the DSIS method

M. Rerabek; P. Hanhart; T. Ebrahimi 

2016

Towards prediction of Sense of Presence in immersive audiovisual communications

A-F. N. M. Perrin; M. Rerabek; T. Ebrahimi 

2016. Human Vision and Electronic Imaging (HVEI) 2016, San Francisco, February 14-18, 2016. DOI : 10.2352/ISSN.2470-1173.2016.16.HVEI-128.

Modeling Immersive Media Experiences by Sensing Impact on Subjects

E. Kroupi; P. Hanhart; J-S. Lee; M. Rerabek; T. Ebrahimi 

Multimedia Tools and Applications. 2015.  p. 1-21. DOI : 10.1007/s11042-015-2980-z.

Towards high dynamic range extensions of HEVC: subjective evaluation of potential coding technologies

P. Hanhart; M. Rerabek; T. Ebrahimi 

2015. SPIE Optical Engineering + Applications, San Diego, California, USA, August 10-13, 2015. p. 95990G. DOI : 10.1117/12.2193832.

Multimodal Dataset for Assessment of Quality of Experience in Immersive Multimedia

A-F. N. M. Perrin; H. Xu; E. Kroupi; M. Rerabek; T. Ebrahimi 

2015. ACMMULTIMEDIA 2015 (ACM MM), Brisbane, Australia, October 26-30, 2015. DOI : 10.1145/2733373.2806387.

[ISO/IEC JTC 1/SC 29/WG1 contribution] EPFL Light-Field Image Dataset

M. Rerabek; L. Yuan; L. A. Authier; T. Ebrahimi 

2015

[ISO/IEC MPEG contribution] Results of HDR CfE subjective evaluations conducted at EPFL

P. Hanhart; M. Rerabek; T. Ebrahimi 

2015

Quality Evaluation of HEVC and VP9 Video Compression in Real-Time Applications

M. Rerabek; P. Hanhart; P. Korshunov; T. Ebrahimi 

2015. 7th International Workshop on Quality of Multimedia Experience (QoMEX), Costa Navarino, Messinia, Greece, May 26-29, 2015. DOI : 10.1109/QoMEX.2015.7148088.

Subjective and objective evaluation of HDR video compression

M. Rerabek; P. Hanhart; P. Korshunov; T. Ebrahimi 

2015. 9th International Workshop on Video Processing and Quality Metrics for Consumer Electronics (VPQM), Chandler, Arizona, USA, February 5-6, 2015.

[ISO/IEC MPEG contribution] Correlation of subjective scores and objective metrics for HDR video quality assessment

M. Rerabek; P. Korshunov; P. Hanhart; T. Ebrahimi 

2014

Evaluation of privacy in high dynamic range video sequences

M. Rerabek; L. Yuan; L. Krasula; P. Korshunov; K. Fliegel et al. 

2014. SPIE Optical Engineering + Applications, San Diego, California, USA, August 18-21, 2014. DOI : 10.1117/12.2065559.

Comparison of compression efficiency between HEVC/H.265 and VP9 based on subjective assessments

M. Rerabek; T. Ebrahimi 

2014. SPIE Optical Engineering + Applications, San Diego, California, USA, August 18-21, 2014. DOI : 10.1117/12.2065561.

EEG correlates during video quality perception

E. Kroupi; P. Hanhart; J-S. Lee; M. Rerabek; T. Ebrahimi 

2014. 22nd European Signal Processing Conference (EUSIPCO), Lisbon, Portugal, September 1-5, 2014.

Predicting Subjective Sensation of Reality During Multimedia Consumption Based on EEG and Peripheral Physiological Signals

E. Kroupi; P. Hanhart; J-S. Lee; M. Rerabek; T. Ebrahimi 

2014. IEEE International Conference on Multimedia and Expo (ICME), Chengdu, China, July 14-18, 2014. DOI : 10.1109/ICME.2014.6890239.

A new database of still and moving High Dynamic Range pictures

M. Rerabek; T. Ebrahimi 

2014. HDRi2014 -Second International Conference and SME Workshop on HDR imaging, Sarajevo, Bosnia and Herzegovina, March 04-05, 2014.

Audiovisual focus of attention and its application to Ultra High Definition video compression

M. Rerabek; H. Nemoto; J-S. Lee; T. Ebrahimi 

2014. SPIE electronic Imaging, San Francisco, California, USA, February 02, 2014. DOI : 10.1117/12.2047850.

User-independent classification of 2D versus 3D multimedia experiences through EEG and physiological signals

E. Kroupi; P. Hanhart; J-S. Lee; M. Rerabek; T. Ebrahimi 

2014. 8th International Workshop on Video Processing and Quality Metrics for Consumer Electronics – VPQM 2014, Chandler, Arizona, USA, January 30-31, 2014.

Subjective evaluation of an active crosstalk reduction system for mobile autostereoscopic displays

A. Chappuis; M. Rerabek; P. Hanhart; T. Ebrahimi 

2014. SPIE Electronic Imaging, San Francisco, California, USA, February 2-6, 2014. DOI : 10.1117/12.2040391.

JPEG backward compatible format for 3D content representation

P. Hanhart; P. Korshunov; M. Rerabek; T. Ebrahimi 

2013. 14th International Workshop on Image and Audio Analysis for Multimedia Interactive Services, Paris, France, July 3-5, 2013. DOI : 10.1109/WIAMIS.2013.6616156.

Automatic defect detection in video archives – Application to Montreux Jazz Festival Digital Archives

P. Hanhart; M. Rerabek; I. Ivanov; A. Dufaux; C. Jones et al. 

2013. SPIE Optical Engineering + Applications, San Diego, California, USA, August 25-29, 2013. p. 88560R. DOI : 10.1117/12.2026875.

[JCT-VC contribution] AhG4: Subjective evaluation of HEVC intra coding for still image compression

P. Hanhart; M. Rerabek; P. Korshunov; T. Ebrahimi 

2013

Subjective evaluation of HEVC intra coding for still image compression

P. Hanhart; M. Rerabek; P. Korshunov; T. Ebrahimi 

2013. Seventh International Workshop on Video Processing and Quality Metrics for Consumer Electronics – VPQM 2013, Scottsdale, Arizona, USA, January 30 – February 1, 2013.

3D Video Quality Assessment

P. Hanhart; F. De Simone; M. Rerabek; T. Ebrahimi 

Emerging Technologies for 3D Video: Creation, Coding, Transmission and Rendering; John Wiley & Sons Inc, 2013. p. 378-393.

Subjective quality evaluation of the upcoming HEVC video compression standard

P. Hanhart; M. Rerabek; F. De Simone; T. Ebrahimi 

2012. SPIE Optical Engineering + Applications, San Diego, California, USA, August 13-16, 2012. DOI : 10.1117/12.946036.

Comparison of 3D portable display restitution techniques based on stereo and motion parallax

M. Rerabek; T. Ebrahimi 

2012. QoMEX 2012, Yarra Valley, 5-7 July 2012. p. 80-85. DOI : 10.1109/QoMEX.2012.6263858.

[ISO/IEC MPEG contribution] 3DV: Objective quality measurement for the 2-view case scenario

P. Hanhart; F. De Simone; M. Rerabek; T. Ebrahimi 

2012

Towards certification of 3D video quality assessment

A. Perkis; J. You; L. Xing; T. Ebrahimi; F. De Simone et al. 

2012. 6th International Workshop on Video Processing and Quality Metrics for Consumer Electronics – VPQM 2012, Scottsdale, Arizona, USA, January 19-20, 2012.

Motion Parallax Based Restitution of 3D Images on Legacy Consumer Mobile Devices

M. Rerabek; L. Goldmann; J. S. Lee; T. Ebrahimi 

2011. 13th international workshop on multimedia signal processing, Hangzhou, China, October 17-19, 2011. DOI : 10.1109/MMSP.2011.6093789.