高级搜索

留言板

尊敬的读者、作者、审稿人, 关于本刊的投稿、审稿、编辑和出版的任何问题, 您可以本页添加留言。我们将尽快给您答复。谢谢您的支持!

姓名
邮箱
手机号码
标题
留言内容
验证码

基于观测概率有效下界估计的二维激光雷达和摄像机标定方法

彭梦 万琴 陈白帆 邬书跃

彭梦, 万琴, 陈白帆, 邬书跃. 基于观测概率有效下界估计的二维激光雷达和摄像机标定方法[J]. 电子与信息学报, 2022, 44(7): 2478-2487. doi: 10.11999/JEIT210800
引用本文: 彭梦, 万琴, 陈白帆, 邬书跃. 基于观测概率有效下界估计的二维激光雷达和摄像机标定方法[J]. 电子与信息学报, 2022, 44(7): 2478-2487. doi: 10.11999/JEIT210800
PENG Meng, WAN Qin, CHEN Baifan, WU Shuyue. A Calibration Method of 2D Lidar and a Camera Based on Effective Lower Bound Estimation of Observation Probability[J]. Journal of Electronics & Information Technology, 2022, 44(7): 2478-2487. doi: 10.11999/JEIT210800
Citation: PENG Meng, WAN Qin, CHEN Baifan, WU Shuyue. A Calibration Method of 2D Lidar and a Camera Based on Effective Lower Bound Estimation of Observation Probability[J]. Journal of Electronics & Information Technology, 2022, 44(7): 2478-2487. doi: 10.11999/JEIT210800

基于观测概率有效下界估计的二维激光雷达和摄像机标定方法

doi: 10.11999/JEIT210800
基金项目: 国家自然科学基金(62173134, 62006075),湖南省自然科学基金(2021JJ10002, 2020JJ4246),湖南省教育厅资助科研项目(18B386, 18A356),湖南省大学生创新创业训练计划(S201911342021)
详细信息
    作者简介:

    彭梦:男,1978年生,博士,讲师,研究方向为多传感器融合

    万琴:女,1980年生,博士,教授,研究方向为机器视觉、机器人多目标定位跟踪

    陈白帆:女,1979年生,博士,副教授,研究方向为移动机器人环境感知与定位

    邬书跃:男,1963年生,博士,教授,研究方向为数字信号处理

    通讯作者:

    彭梦 pengmeng@hnie.edu.cn

  • 中图分类号: TN958.98; TN911.7

A Calibration Method of 2D Lidar and a Camera Based on Effective Lower Bound Estimation of Observation Probability

Funds: The National Natural Science Foundation of China (62173134, 62006075), The Natural Science Foundation of Hunan Province (2021JJ10002, 2020JJ4246), The Hunan Education Department Funded Research Project (18B386, 18A356), The Innovation and Entrepreneurship Training Program for College Students in Hunan Province (S201911342021)
  • 摘要: 针对2D激光雷达和摄像机最小解标定方法的多解问题,该文提出一种基于观测概率有效下界估计的标定方法。首先,提出一种最小解集合的分级聚类方法,将每类最优解替换原来的解集合,从而减少解集合样本个数。然后,提出一种基于激光误差的联合观测概率度量,对解集合元素的优劣进行度量。最后,利用聚类结果和观测概率度量结果,该文提出基于观测概率有效下界估计的有效解选取策略,将优化初始值从最优解转化为有效解候选集合,提高了标定结果的准确性。仿真实验结果表明,在真解命中率性能上相比于Francisco方法,该文方法在不同棋盘格个数情况下提升真解命中率16%~20%,在不同噪声水平下提升真解命中率6%~20%,有效提高真解比例。
  • 图  1  2维激光雷达坐标系和摄像机坐标系转换关系

    图  2  局部最优观测概率分布示意图,其中${\hat p_{{\rm{opt}}}}$为观测概率有效下界

    图  3  3种方法的真解命中率对比分析

    图  4  不同棋盘格个数输入下3种方法的误差均值

    图  5  不同棋盘格数目情况下3种方法标定误差值的分布

    图  6  不同激光噪声方差情况下3种方法的误差均值

    图  7  不同激光噪声方差情况下3种方法标定误差值的分布

    图  8  激光点在图像上的投影结果

    图  9  真实实验中旋转矩阵分布和平移向量分布示意图

    表  1  本文所提标定算法伪代码

     输入: 基于$ N $个棋盘格${{\boldsymbol{\varPi}} _i}$和对应的共面直线${\boldsymbol{L}}_i^{\rm{l}}$。
     输出: 旋转矩阵${\boldsymbol{R}}$和平移向量$ t $。
     (1) 构造一个集合${\boldsymbol{K} } = \left\{ {\left. { {k_1},{k_2}, \cdots ,{k_d} } \right\} } \right.\;\left( {d = C_N^3} \right)$,其中$ {k_i} \in {Z^3} $表示从$\left\{ {\left. {1,2, \cdots ,N} \right\} } \right.$的$ N $个数中选取3个数的一种可能组合,${\boldsymbol{K}}$表示所有
      的可能组合。
     (2) 设置解集合${\boldsymbol{D}} = \phi$, ${\boldsymbol{S}} = \phi$。
     (3) For t =1,2,···, d do
     (4) 选择和$ {k_t} $的各元素对应的3个棋盘格${{\boldsymbol{\varPi}} _{ {k_{t,1} } } }$, ${{\boldsymbol{\varPi}} _{ {k_{t,2} } } }$和${{\boldsymbol{\varPi}} _{ {k_{t,3} } } }$以及对应的共面直线${\boldsymbol{L} }_{ {k_{t,1} } }^{\text{l} }$, ${\boldsymbol{L}}_{ {k_{t,2} } }^l$和${\boldsymbol{L}}_{ {k_{t,3} } }^l$,使用文献[5]的算法计算一组最
      小解$\left( {{\boldsymbol{R}}_t^{(m)},{\boldsymbol{t}}_t^{(m)} } \right)$, $ m \lt 8 $。
     (5) 将当前这组解合并到解集合${\boldsymbol{D}} = {\boldsymbol{D}} \cup \left( {{\boldsymbol{R}}_t^{(m)},{\boldsymbol{t}}_t^{(m)} } \right)$。
     (6) End for
     (7) 利用式(3)和式(4)作为类之间的距离度量,对解集合${\boldsymbol{D}}$进行分级聚类,聚类结果为$ \left\{ {{C_i}} \right\}_{i = 1}^k $。
     (8) 根据式(8)—式(11)计算基于激光误差的联合观测概率$ {\pi _j} $。
     (9) 根据聚类结果$ \left\{ {{C_i}} \right\}_{i = i}^k $和联合观测概率$ {\pi _j} $,利用式(12)获取每类中局部最优观测概率的解$\left\{ {\left( { { {\tilde {\boldsymbol{R}}}_i},{ {\tilde {\boldsymbol{t}}}_i} } \right)} \right\}_{i = i}^k$,其对应的观测概率为
      $ \left\{ {{p_i}} \right\}_{i = i}^k $。
     (10) 根据式(13)计算观测概率有效下界${\hat p_{{\rm{opt}}} }$,将${p_i} \gt {\hat p_{{\rm{opt}}} }$的局部最优解$\left( { { {\tilde {\boldsymbol{R}}}_i},{ {\tilde {\boldsymbol{t}}}_i} } \right)$加入到有效解候选集合$ S $,将$ S $作为标定参数优化的初始值。
    下载: 导出CSV

    表  2  本文方法的有效解个数以及运算时间的比较

    棋盘格的个数
    345678
    本文方法的有效解个数均值(个)2.12.32.42.62.72.7
    本文方法的运算时间(s)1.3511.7252.4372.6503.8964.682
    Francisco方法的运算时间(s)0.2100.3510.5310.7201.2411.631
    下载: 导出CSV
  • [1] SAKTHIVEL P and ANBARASU B. Integration of vision and LIDAR for navigation of micro aerial vehicle[C]. The 2020 Third International Conference on Multimedia Processing, Communication & Information Technology (MPCIT), Shivamogga, India, 2020: 14–18.
    [2] LI Zimo, GOGIA P C, and KAESS M. Dense surface reconstruction from monocular vision and LiDAR[C]. The 2019 International Conference on Robotics and Automation (ICRA), Montreal, Canada, 2019: 6905–6911.
    [3] LI Yanhao and LI Hao. A collaborative relative localization method for vehicles using vision and LiDAR sensors[C]. The 2020 16th International Conference on Control, Automation, Robotics and Vision (ICARCV), Shenzhen, China, 2020: 281–286.
    [4] ZHANG Qilong and PLESS R. Extrinsic calibration of a camera and laser range finder (improves camera calibration)[C]. The IEEE/RSJ International Conference on Intelligent Robots and Systems, Sendai, Japan, 2004: 2301−2306.
    [5] ASCONCELOS F, BARRETO J P, and NUNES U. A minimal solution for the extrinsic calibration of a camera and a laser-rangefinder[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(11): 2097–2107. doi: 10.1109/TPAMI.2012.18
    [6] 胡钊政, 赵斌, 李娜, 等. 基于虚拟三面体的摄像机与二维激光测距仪外参数最小解标定新算法[J]. 自动化学报, 2015, 41(11): 1951–1960. doi: 10.16383/j.aas.2015.c150108

    HU Zhaozheng, ZHAO Bin, LI Na, et al. Minimal solution to extrinsic calibration of camera and 2D laser rangefinder based on virtual trihedron[J]. Acta Automatica Sinica, 2015, 41(11): 1951–1960. doi: 10.16383/j.aas.2015.c150108
    [7] 彭梦, 蔡自兴. 基于多约束误差函数的2维激光雷达和摄像机标定方法[J]. 机器人, 2014, 36(6): 662–667,675. doi: 10.13973/j.cnki.robot.2014.0662

    PENG Meng and CAI Zixing. A calibration method of a camera and 2D laser radar based on multi-constraint error function[J]. Robot, 2014, 36(6): 662–667,675. doi: 10.13973/j.cnki.robot.2014.0662
    [8] HOANG V D, HERNÁNDEZ D C, and JO K H. Simple and efficient method for calibration of a camera and 2D laser rangefinder[C]. The 6th Asian Conference on Intelligent Information and Database Systems, Bangkok, Thailand, 2014: 561–570.
    [9] SIM S, SOCK J, and KWAK K. Indirect correspondence-based robust extrinsic calibration of LiDAR and camera[J]. Sensors, 2016, 16(6): 933. doi: 10.3390/s16060933
    [10] DONG Wenbo and ISLER V. A novel method for the extrinsic calibration of a 2D laser rangefinder and a camera[J]. IEEE Sensors Journal, 2018, 18(10): 4200–4211. doi: 10.1109/JSEN.2018.2819082
    [11] ITAMI F and YAMAZAKI T. A simple calibration procedure for a 2D LiDAR with respect to a camera[J]. IEEE Sensors Journal, 2019, 19(17): 7553–7564. doi: 10.1109/JSEN.2019.2915991
    [12] FAN Jia, HUANG Yuchun, SHAN Jie, et al. Extrinsic calibration between a camera and a 2D laser rangefinder using a photogrammetric control field[J]. Sensors, 2019, 19(9): 2030. doi: 10.3390/s19092030
    [13] YE Quan, SHU Leizheng, and ZHANG Wei. Extrinsic calibration of a monocular camera and a single line scanning Lidar[C]. The 2019 IEEE International Conference on Mechatronics and Automation (ICMA), Tianjin, China, 2019: 1047–1054.
    [14] ZHOU Lipu and DENG Zhidong. A new algorithm for the establishing data association between a camera and a 2-D LIDAR[J]. Tsinghua Science and Technology, 2014, 19(3): 314–322. doi: 10.1109/TST.2014.6838203
    [15] GOMEZ-OJEDA R, BRIALES J, FERNANDEZ-MORAL E, et al. Extrinsic calibration of a 2D laser-rangefinder and a camera based on scene corners[C]. The 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, USA, 2015: 3611–3616.
    [16] HU Zhaozheng, LI Yicheng, LI Na, et al. Extrinsic calibration of 2-D laser rangefinder and camera from single shot based on minimal solution[J]. IEEE Transactions on Instrumentation and Measurement, 2016, 65(4): 915–929. doi: 10.1109/TIM.2016.2518248
    [17] ROYER E, SLADE M, and DHOME M. Easy auto-calibration of sensors on a vehicle equipped with multiple 2D-LIDARs and cameras[C]. The 2019 IEEE Intelligent Vehicles Symposium (IV), Paris, France, 2019: 1296–1303.
    [18] 张学工. 模式识别[M]. 3版. 北京: 清华大学出版社, 2010: 203–205.

    ZHANG Xuegong. Pattern Recognition[M]. 3rd ed. Beijing: Tsinghua University Press, 2010: 203–205.
  • 加载中
图(9) / 表(2)
计量
  • 文章访问数:  618
  • HTML全文浏览量:  387
  • PDF下载量:  63
  • 被引次数: 0
出版历程
  • 收稿日期:  2021-08-09
  • 修回日期:  2022-04-01
  • 网络出版日期:  2022-04-14
  • 刊出日期:  2022-07-25

目录

    /

    返回文章
    返回