TY - GEN
T1 - Super-resolution of depth map exploiting planar surfaces
AU - Tilo, Tammam
AU - Jin, Zhi
AU - Cheng, Fei
N1 - Publisher Copyright:
© Springer International Publishing Switzerland 2015.
PY - 2015
Y1 - 2015
N2 - Depth map, with per-pixel depth values, represents the relative distance between object in the scene and the capturing depth camera. Hence, it has been widely used in 3D applications and Depth Image-Based Rendering (DIBR) technique to provide an immersive 3D and free-viewpoint experience to the viewers. Depth maps could be generated by using software- or hardware-driven techniques. However, most generated depth maps suffer from a combination of the following shortcomings: noise, holes and limited spatial resolution. Therefore, to tackle the limited spatial resolution problem of Time-of-Flight depth images, in this paper, we present a planar-surface-based depth map super-resolution approach, which interpolates depth images by exploiting the equation of each detected planar surface. Aided with these equations the surfaces will be categorized into three groups, namely: planar surfaces, non-planar surfaces, and finally edges. For the first category the analytical equations of the planar surfaces will be used to super-resolve them, while a traditional interpolation method will be used for the non-planar surfaces, whereas, a combination of the two previous approaches will be used to up-sample edges. Both quantitative and qualitative experimental results demonstrate the effectiveness and robustness of our approach over the benchmark methods.
AB - Depth map, with per-pixel depth values, represents the relative distance between object in the scene and the capturing depth camera. Hence, it has been widely used in 3D applications and Depth Image-Based Rendering (DIBR) technique to provide an immersive 3D and free-viewpoint experience to the viewers. Depth maps could be generated by using software- or hardware-driven techniques. However, most generated depth maps suffer from a combination of the following shortcomings: noise, holes and limited spatial resolution. Therefore, to tackle the limited spatial resolution problem of Time-of-Flight depth images, in this paper, we present a planar-surface-based depth map super-resolution approach, which interpolates depth images by exploiting the equation of each detected planar surface. Aided with these equations the surfaces will be categorized into three groups, namely: planar surfaces, non-planar surfaces, and finally edges. For the first category the analytical equations of the planar surfaces will be used to super-resolve them, while a traditional interpolation method will be used for the non-planar surfaces, whereas, a combination of the two previous approaches will be used to up-sample edges. Both quantitative and qualitative experimental results demonstrate the effectiveness and robustness of our approach over the benchmark methods.
KW - Depth map
KW - Planar surface detection
KW - Super-resolution
KW - Time-of-flight (Tof) camera
UR - http://www.scopus.com/inward/record.url?scp=84951874594&partnerID=8YFLogxK
U2 - 10.1007/978-3-319-24078-7_65
DO - 10.1007/978-3-319-24078-7_65
M3 - Conference Proceeding
AN - SCOPUS:84951874594
SN - 9783319240770
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 632
EP - 641
BT - Advances in Multimedia Information Processing – PCM 2015 - 16th Pacific-Rim Conference on Multimedia, Proceedings
A2 - Ho, Yo-Sung
A2 - Ro, Yong Man
A2 - Kim, Junmo
A2 - Wu, Fei
A2 - Sang, Jitao
PB - Springer Verlag
T2 - 16th Pacific-Rim Conference on Multimedia, PCM 2015
Y2 - 16 September 2015 through 18 September 2015
ER -