引用本文:余洪山,赵科,王耀南,唐延东,张红良.融合2D/3D摄像机的方法与获取高精度三维视觉信息的装置[J].控制理论与应用,2014,31(10):1383~1392.[点击复制]
YU Hong-shan,ZHAO Ke,WANG Yao-nan,TANG Yan-dong,ZHANG Hong-liang.Fusion of 2D camera with 3D camera and equipment for acquiring high resolution 3D visual information[J].Control Theory and Technology,2014,31(10):1383~1392.[点击复制]
融合2D/3D摄像机的方法与获取高精度三维视觉信息的装置
Fusion of 2D camera with 3D camera and equipment for acquiring high resolution 3D visual information
摘要点击 4121  全文点击 1484  投稿时间:2014-01-16  修订日期:2014-06-06
查看全文  查看/发表评论  下载PDF阅读器
DOI编号  10.7641/CTA.2014.40038
  2014,31(10):1383-1392
中文关键词  2D/3D图像匹配  图像融合  3D摄像机  立体视觉  三维重建
英文关键词  2D/3D image registration  image fusion  3D camera  stereo vision  3D reconstruction
基金项目  国家自然科学基金资助项目(61005068); 国家高技术研究发展计划(\!“863”\!计划)资助项目(2012AA112312); 机器人学国家重点实验室开放课题基金资助项目(2013O09); 国家重大科学仪器设备开发专项项目(2013YQ140517); 广东省教育部产学研结合资助项目(2011B090400074); 中央高校基本科研业务费专项资金资助项目.
作者单位E-mail
余洪山* 湖南大学 电气与信息工程学院
机器人学国家重点实验室 
yuhongshancn@hotmail.com 
赵科 湖南大学 电气与信息工程学院  
王耀南 湖南大学 电气与信息工程学院  
唐延东 机器人学国家重点实验室  
张红良 国防科学技术大学 航天科学与工程学院  
中文摘要
      三维飞行时间摄像机可实时同步获取场景三维信息和灰度图像信息. 虽然它存在图像分辨率和质量较差等问题, 但它可作为二维摄像机的互补. 本文借鉴立体视觉技术, 提出了一种2D/3D摄像机融合的三维视觉信息获取方案. 论文首先基于固定空间关系和相近视野原则, 设计2D/3D立体摄像机系统对空间场景同步成像. 结合三维TOF摄像机成像特性, 论文借鉴立体视觉技术完成二维摄像机的高质量二维彩色图像与插补后的三维摄像机深度图像的匹配关联. 因此, 本方法可实现场景的高精度彩色图像和对应三维空间信息的实时同步获取, 同事保留了二维摄像机的高质量彩色二维成像和三维摄像机的快速稠密三维信息获取的优势. 2D/3D摄像机图像融合匹配算法复杂度低, 匹配精度和准确度取决于二维摄像机和三维摄像机自身性能、摄像机标定参数精度和深度图像插补算法, 不会引入新的运算误差. 试验结果验证了本文算法的有效性和精确度.
英文摘要
      Time of flight (ToF) camera can deliver grayscale image and 3D information simultaneously with high frame rates. Although its image resolution and quality are very poor, it provides a good supplement with traditional 2D camera image. Inspired by the stereo vision, we present a 3D visual information acquiring method by fusing 3D information of ToF camera with the high resolution color image. Firstly, we setup a 2D/3D stereo camera with fixed spatial relation and similar visual field to capture the environment information synchronously. Based on characteristics of ToF camera and the principles of stereo vision, the interpolated 3D information of ToF camera is registered with high resolution color image. Consequently, the proposed method can provide high quality 2D image as well as corresponding 3D space information, which preserves the advantages of 2D camera.s high quality image and ToF camera’s fast acquisition for dense 3D information. The proposed 2D/3D camera fusion method has very low computation cost while the matching accuracy is only determined by parameters of the 2D/3D stereo camera system and interpolation algorithm for range image without extra computation error. Experimental results have demonstrated the feasibility and accuracy of the proposed method.