基于字符注意力的自然场景文本识别
DOI:
作者:
作者单位:

(1.湖北工业大学 电气与电子工程学院,湖北 武汉 430068; 2.襄阳湖北工业大学产业研究院,湖北 襄阳 441003; 3.美国南卡罗来纳大学 计算机科学与工程系, 南卡 哥伦比亚 29201)

作者简介:

熊 炜 (1976-),男,博士,副教授,硕士生导师,主要从事数字图像处理和计算机视觉方面的研究.

通讯作者:

中图分类号:

基金项目:

国家自然科学基金(61571182,61601177)、湖北省自然科学基金(2019CFB530)、湖北省科技厅重大专项 (2019ZYYD020)和襄阳湖北工业大学产业研究院科研项目(XYYJ2022C05)和国家留学基金(201808420418)资助项目


Natural scene text recognition based on character attention
Author:
Affiliation:

(1.School of Electrical and Electronic Engineering, Hubei University of Technology, Wuhan, Hubei 430068, China;2.Xiangyang Industrial Research Institute, Hubei University of Technology, Xiangyang, Hubei 441003, China;3.Department of Computer Science and Engineering, University of South Carolina, Columbia, SC 29201, USA)

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    自然场景文本识别中采用固定大小的卷积核提取视觉特征,后仅进行字符分类的方法,其全局建模能力弱且忽视了文本语义建模的重要性,因此,本文提出一种基于字符注意力的自然场景文本识别方法。首先构建不同于卷积网络的多级efficient Swin Transformer提取特征,其可使不同窗口的特征进行信息交互;其次设计了字符注意力模块 (character attention module,CAM) ,使网络专注于字符区域的特征,以提取识别度更高的视觉特征;并设计语义推理模块(semantic reasoning module,SRM) ,根据字符的上下文信息对文本序列进行建模,获得语义特征来纠正不易区分或模糊的字符;最后融合视觉和语义特征,分类得到字符识别结果。实验结果表明,在规则文本数据集IC13上识别准确率达到了95.2%,在不规则的弯曲文本数据集CUTE上达到了85.8%,通过消融及对比实验证明了本文提出的方法可行。

    Abstract:

    In natural scene text recognition,a fixed size convolution kernel is used to extract visual features,and then character classification is performed.The global modeling ability of this method is weak and it ignores the importance of text semantic modeling.Therefore,this paper proposes a natural scene text recognition method based on character attention.Firstly,a multi-level efficient Swin Transformer network is constructed to extract features,which is different from the convolutional network.This network can make the features of different windows interact with each other.Secondly,the character attention module (CAM) is designed to make the network focus on the features of the character region,so as to extract the visual features with higher recognition ability.Then,the semantic reasoning module (SRM) is designed to model the text sequence according to the context information of characters.And the module can obtain semantic features to correct the indistinguishable or fuzzy characters.At last,visual and semantic features are fused to get the results of character recognition.The experimental results show that the recognition accuracy in this paper reaches 95.2% on the regular text data set IC13 and 85.8% on the irregular curved text data set CUTE.The feasibility of the proposed method is proved by ablative and comparative experiments.

    参考文献
    相似文献
    引证文献
引用本文

熊炜,孙鹏,赵迪,刘粤.基于字符注意力的自然场景文本识别[J].光电子激光,2023,34(11):1158~1167

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2022-09-06
  • 最后修改日期:2022-12-26
  • 录用日期:
  • 在线发布日期: 2023-11-16
  • 出版日期: