YOLO-NKLT视觉SLAM回环检测方法
DOI:
CSTR:
作者:
作者单位:

(天津理工大学 计算机视觉与系统教育部重点实验室和天津市智能计算及软件新技术重点实验室,天津 300384)

作者简介:

温显斌 (1966-),男,博士,教授,博士生导师,硕士生导师,主要的研究领域为遥感图像理解、模式识别、计算机视觉、多媒体分析、信息隐藏等.

通讯作者:

中图分类号:

基金项目:

天津市高等学校自然科学研究项目(2017ZD13)资助项目


YOLO-NKLT visual SLAM loopback detection method
Author:
Affiliation:

(Key Laboratory on Computer Vision and System,Ministry of Education of China,Key Laboratory on Intelligence Computing and Novel Software Technology of the City of Tianjin, Tianjin University of Technology, Tianjin 300384, China)

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对存在明显光照变化或遮挡物等室外复杂场景下,现有基于深度学习的视觉即时定位与地图构建(visual simultaneous localization and mapping,视觉SLAM)回环检测方法没有很好地利用图像的语义信息、场景细节且实时性差等问题,本文提出了一种YOLO-NKLT视觉SLAM回环检测方法。采用改进损失函数的YOLOv5网络模型获取具有语义信息的图像特征,构建训练集,对网络重训练,使提取的特征更加适用于复杂场景下的回环检测。为了进一步提高闭环检测的实时性,提出了一种基于非支配排序的KLT降维方法。通过在New College数据集和光照等变化更复杂的Nordland数据集上进行实验,结果表明:室外复杂场景下,相较于其他传统和基于深度学习的方法,所提方法具有更高的鲁棒性,可以取得更佳的准确率和实时性表现。

    Abstract:

    Aiming at the problems that the existing deep learning based visual simultaneous localization and mapping (visual SLAM) loopback detection methods do not make good use of the semantic information of images,scene details and poor real-time performance in complex outdoor scenes with obvious illumination changes or occlusion objects,this paper proposes an YOLO-NKLT visual SLAM loopback detection method.The YOLOv5 network model with improved loss function is used to obtain image features with semantic information,construct the training set,and retrain the network to make the extracted features more suitable for loopback detection in complex scenes.In order to further improve the real-time performance of closed-loop detection,a KLT dimensionality reduction method based on non-dominated sorting is proposed.Through experiments on the New College dataset and Nordland dataset with more complex changes such as illumination,the results show that compared with other traditional and deep learn-based methods in outdoor complex scenes,it has higher robustness and can achieve better accuracy and real-time rate performance.

    参考文献
    相似文献
    引证文献
引用本文

刘玮,温显斌. YOLO-NKLT视觉SLAM回环检测方法[J].光电子激光,2023,34(4):405~412

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2022-05-30
  • 最后修改日期:2022-09-18
  • 录用日期:
  • 在线发布日期: 2023-04-13
  • 出版日期:
文章二维码