3DTV video synthesis using depth cameras and color cameras

Ismaël Daribo, François De Sorbier, Yuko Uematsu, Yuki Takaya, Hideo Saito

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Novel view synthesis within 3D multiview imaging system has become a key task for offering depth perception, and/or providing the ability to freely change the viewpoint position and viewpoint direction. In that sense multiview video (MVV) system has gained significant interest recently, notably for its capacity to synthesis novel views through Depth Image Based Rendering (DIBR). However, the rendering process does not allow to create perfect novel views in general, it is still prone to errors in particular from the 3D-image-warping- induced disocclusions and the coding/transmission of the depth video, which is a key side information in 3DTV video synthesis. In this paper, we introduce our recent researches related to multiview video analysis for enhancing 3DTV video synthesis quality within a multiple color and depth camera framework. In particular we focus on the depth video pre-processing and a GPU-based post-processing that speeds-up the rendering of multiple novel views, in order to achieve satisfactory perceived image quality and viewing comfort.

Original languageEnglish
Title of host publicationAPSIPA ASC 2010 - Asia-Pacific Signal and Information Processing Association Annual Summit and Conference
Pages6-14
Number of pages9
Publication statusPublished - 2010
Event2nd Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2010 - Biopolis, Singapore
Duration: 2010 Dec 142010 Dec 17

Other

Other2nd Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2010
CountrySingapore
CityBiopolis
Period10/12/1410/12/17

Fingerprint

Cameras
Color
Depth perception
Processing
Imaging systems
Image quality

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Information Systems

Cite this

Daribo, I., De Sorbier, F., Uematsu, Y., Takaya, Y., & Saito, H. (2010). 3DTV video synthesis using depth cameras and color cameras. In APSIPA ASC 2010 - Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (pp. 6-14)

3DTV video synthesis using depth cameras and color cameras. / Daribo, Ismaël; De Sorbier, François; Uematsu, Yuko; Takaya, Yuki; Saito, Hideo.

APSIPA ASC 2010 - Asia-Pacific Signal and Information Processing Association Annual Summit and Conference. 2010. p. 6-14.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Daribo, I, De Sorbier, F, Uematsu, Y, Takaya, Y & Saito, H 2010, 3DTV video synthesis using depth cameras and color cameras. in APSIPA ASC 2010 - Asia-Pacific Signal and Information Processing Association Annual Summit and Conference. pp. 6-14, 2nd Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2010, Biopolis, Singapore, 10/12/14.
Daribo I, De Sorbier F, Uematsu Y, Takaya Y, Saito H. 3DTV video synthesis using depth cameras and color cameras. In APSIPA ASC 2010 - Asia-Pacific Signal and Information Processing Association Annual Summit and Conference. 2010. p. 6-14
Daribo, Ismaël ; De Sorbier, François ; Uematsu, Yuko ; Takaya, Yuki ; Saito, Hideo. / 3DTV video synthesis using depth cameras and color cameras. APSIPA ASC 2010 - Asia-Pacific Signal and Information Processing Association Annual Summit and Conference. 2010. pp. 6-14
@inproceedings{e7a2a6fb35584469a8103b41f0c7325a,
title = "3DTV video synthesis using depth cameras and color cameras",
abstract = "Novel view synthesis within 3D multiview imaging system has become a key task for offering depth perception, and/or providing the ability to freely change the viewpoint position and viewpoint direction. In that sense multiview video (MVV) system has gained significant interest recently, notably for its capacity to synthesis novel views through Depth Image Based Rendering (DIBR). However, the rendering process does not allow to create perfect novel views in general, it is still prone to errors in particular from the 3D-image-warping- induced disocclusions and the coding/transmission of the depth video, which is a key side information in 3DTV video synthesis. In this paper, we introduce our recent researches related to multiview video analysis for enhancing 3DTV video synthesis quality within a multiple color and depth camera framework. In particular we focus on the depth video pre-processing and a GPU-based post-processing that speeds-up the rendering of multiple novel views, in order to achieve satisfactory perceived image quality and viewing comfort.",
author = "Isma{\"e}l Daribo and {De Sorbier}, Fran{\cc}ois and Yuko Uematsu and Yuki Takaya and Hideo Saito",
year = "2010",
language = "English",
pages = "6--14",
booktitle = "APSIPA ASC 2010 - Asia-Pacific Signal and Information Processing Association Annual Summit and Conference",

}

TY - GEN

T1 - 3DTV video synthesis using depth cameras and color cameras

AU - Daribo, Ismaël

AU - De Sorbier, François

AU - Uematsu, Yuko

AU - Takaya, Yuki

AU - Saito, Hideo

PY - 2010

Y1 - 2010

N2 - Novel view synthesis within 3D multiview imaging system has become a key task for offering depth perception, and/or providing the ability to freely change the viewpoint position and viewpoint direction. In that sense multiview video (MVV) system has gained significant interest recently, notably for its capacity to synthesis novel views through Depth Image Based Rendering (DIBR). However, the rendering process does not allow to create perfect novel views in general, it is still prone to errors in particular from the 3D-image-warping- induced disocclusions and the coding/transmission of the depth video, which is a key side information in 3DTV video synthesis. In this paper, we introduce our recent researches related to multiview video analysis for enhancing 3DTV video synthesis quality within a multiple color and depth camera framework. In particular we focus on the depth video pre-processing and a GPU-based post-processing that speeds-up the rendering of multiple novel views, in order to achieve satisfactory perceived image quality and viewing comfort.

AB - Novel view synthesis within 3D multiview imaging system has become a key task for offering depth perception, and/or providing the ability to freely change the viewpoint position and viewpoint direction. In that sense multiview video (MVV) system has gained significant interest recently, notably for its capacity to synthesis novel views through Depth Image Based Rendering (DIBR). However, the rendering process does not allow to create perfect novel views in general, it is still prone to errors in particular from the 3D-image-warping- induced disocclusions and the coding/transmission of the depth video, which is a key side information in 3DTV video synthesis. In this paper, we introduce our recent researches related to multiview video analysis for enhancing 3DTV video synthesis quality within a multiple color and depth camera framework. In particular we focus on the depth video pre-processing and a GPU-based post-processing that speeds-up the rendering of multiple novel views, in order to achieve satisfactory perceived image quality and viewing comfort.

UR - http://www.scopus.com/inward/record.url?scp=79958124107&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79958124107&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:79958124107

SP - 6

EP - 14

BT - APSIPA ASC 2010 - Asia-Pacific Signal and Information Processing Association Annual Summit and Conference

ER -