基于改进RT-DETR和FPFH特征的多模态3D点云配准方法
DOI:
CSTR:
作者:
作者单位:

1.华北理工大学 电气工程学院;2.唐山市钢铁企业流程控制与优化技术创新中心(唐山阿诺达自动化有限公司)

作者简介:

通讯作者:

中图分类号:

TP391.41

基金项目:

国家自然科学基金(NO.52374335)、唐山市科技计划项目(22130204G,22130220G)


Multi modal 3D point cloud registration method based on improved RT-DETR and FPFH features
Author:
Affiliation:

1.College of Electrical Engineering, North China University of Science and Technology;2.Tangshan Arnoda Automation Co., Ltd. (Steel Process Control and Optimization Technology Innovation Center)

Fund Project:

The National Natural Science Foundation of China (NO.52374335),Tangshan Science and Technology Plan Project(22130204G,22130220G)

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对工业场景下传统点云配准方法对微小几何特征敏感度低、受噪声和遮挡干扰严重、实时性不足等问题,本文提出了一种基于图像检测与几何特征融合的多模态三维点云配准方法。首先,利用改进型RT-DETR(real-time detection transformer)算法进行工件识别与兴趣区域(region of interest,ROI)分割,并通过体素滤波实现点云下采样预处理。其次,提出了一种多尺度曲率加权的描述子FPFH-MSW(fast point feature histogram with multi-scale curvature weighting),结合双向一致性搜索策略完成全局粗配准。最后,设计自适应鲁棒损失函数APEH(adaptive penalty error hybrid loss),提高模型的抗干扰能力,实现精细对齐。实验结果表明,所提方法能够快速准确识别多种形状的散乱堆叠工件,配准效果显著优于传统算法,为复杂工业场景下工件的自动化识别与高精度定位提供了一种高效可靠的方法。

    Abstract:

    To address the low sensitivity to subtle geometric features, vulnerability to noise and occlusion, and limited real-time capability of conventional point cloud registration methods in industrial environments, this paper presents a multimodal 3D point cloud registration approach that fuses image-based detection with geometric descriptors. First, an improved Real-Time Detection Transformer (RT-DETR) is used for workpiece detection and region of interest (ROI) segmentation. The corresponding point cloud regions are then preprocessed using voxel grid filtering for downsampling to reduce computational cost. Second, we propose a multi-scale curvature-weighted descriptor, Fast Point Feature Histogram with Multi-Scale Curvature Weighting (FPFH-MSW), and employ a bidirectional consistency search strategy to obtain robust global coarse registration. Finally, an adaptive robust loss, the Adaptive Penalty Error Hybrid (APEH) loss, is developed to fine-tune alignment and enhance robustness to noise and occlusion, thereby refining alignment accuracy. Extensive experiments demonstrate that the proposed method achieves fast and accurate detection and registration of a variety of scattered and stacked workpieces, outperforming conventional algorithms in both registration accuracy and robustness. The method thus offers an efficient and reliable solution for automated part identification and high-precision localization in complex industrial scenarios.

    参考文献
    相似文献
    引证文献
引用本文
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2025-08-02
  • 最后修改日期:2025-10-11
  • 录用日期:2025-10-27
  • 在线发布日期:
  • 出版日期:
文章二维码