融入特征交互与注意力的轻量化混凝土裂缝分割算法
Lightweight concrete crack segmentation algorithm integrating feature interaction and attention
投稿时间:2024-02-04  修订日期:2024-04-02
DOI:
中文关键词:  图像处理  混凝土裂缝语义分割  DeepLabV3  轻量化  尺度内特征交互  注意力机制
英文关键词:image processing  concrete crack semantic segmentation  DeepLabV3  lightweight  intrascale feature interaction  attention mechanism
基金项目:贵州省基础研究自然科学项目(黔科合基础-ZK[2021]重点001)
作者单位邮编
彭垚潘 贵州大学大数据与信息工程学院 550000
张荣芬* 贵州大学大数据与信息工程学院 550000
刘宇红 贵州大学大数据与信息工程学院 
欧阳玉旋 贵州大学大数据与信息工程学院 
摘要点击次数: 62
全文下载次数: 0
中文摘要:
      裂缝可能构成对混凝土建筑最大的安全隐患,为了高效地分割混凝土裂缝,及时检测和评估其危害,提出一种改进DeepLabV3 的轻量化裂缝分割算法。首先,使用MobileNetV3作为轻量级主干网络,大幅降低模型参数量;其次,使用尺度内特征交互模块替换空洞卷积分支并引入基于归一化的注意力机制,增强特征全局信息表达能力,促进多层次裂缝特征信息交互;此外,提取低层次特征后引入混合注意力机制,更有效提取高分辨率裂缝图像的细节特征;最后,提出结合通道空间重建卷积和全局注意力机制的C2f-SCConv模块,对融合后的高低层级特征流解码,减小计算冗余的同时提升模型对多尺度特征丰富语义信息和细节信息的感知能力。在公共裂缝数据集Crack3k和Asphalt3k上的实验结果表明,提出的模型参数量相比DeepLabV3 模型降低了88.1%,浮点运算量降低83.8%,像素准确率提升0.02%,平均交并比达到了86.21%,平均帧率为47.91帧/秒,在显著降低模型复杂度的同时提高了模型的分割效能。
英文摘要:
      Concrete cracks pose a significant safety hazard to concrete structures. To effectively segment concrete cracks while promptly detecting and evaluating their potential risks, proposes an improved lightweight crack semantic segmentation algorithm based on DeepLabV3 . Firstly, MobileNetV3 is employed as a lightweight backbone network to significantly reduce the model's parameter size. Secondly, the Attention-based Intrascale Feature Interaction module (AIFI), which integrates feature interaction within scales, replaces the dilated convolution branch, and the Normalization-based Attention Module (NAM), is introduced to enhance the global information representation of features, and promoting multi-level interaction of crack feature information. Additionally, the mixed model of both self-Attention and Convolution (ACmix) , is introduced after extracting low-level features to more effectively capture detailed features of high-resolution crack images. Finally, the C2f-SCConv module, combining Spatial and Channel Reconstruction Convolution (SCConv) and Global Attention Mechanism (GAM), is proposed to decode the fused high and low-level feature streams, reducing computational redundancy while improving the model's perception of multi-scale semantic and detail information. Experimental results compared with other segmentation algorithms on the public crack datasets, Crack3k and Asphalt3k, demonstrate that the proposed concrete crack detection model reduces the parameter size by 88.1% and the floating-point operations by 83.8% compared to the DeepLabV3 model. It achieves a pixel accuracy improvement of 0.02% and an average intersection over union of 86.21%, The average frame rate is 47.91 frames per second. The model significantly improves segmentation performance while reducing model complexity.
    下载PDF阅读器
关闭

版权所有:《光电子·激光》编辑部  津ICP备12008651号-1
主管单位:天津市教育委员会 主办单位:天津理工大学 地址:中国天津市西青区宾水西道391号
技术支持:北京勤云科技发展有限公司