结合强监督学习和生成对抗网络的图像去雾
DOI:
作者:
作者单位:

(1.西安邮电大学 计算机学院,陕西 西安 710121; 2.陕西省网络数据分析与智能处理重点实验室,陕西 西安 710121)

作者简介:

翟社平 (1971-),男,博士,教授,硕士生导师,主要从事计算机视觉、自然语言处理与人工智能方面的研究.

通讯作者:

中图分类号:

基金项目:

国家自然科学基金(61373116)、陕西省重点研发计划项目(2022GY-038)、陕西省大学生创新创业训练计划 项目(S202111664004,S202111664077)和西安邮电大学研究生创新基金(CXJJLY202051)资助项目


Image dehazing combining strongly-supervised learning and generative adversarial network
Author:
Affiliation:

(1.School of Computer Science and Technology, Xi′an University of Posts and Telecommunications, Xi′an, Shaanxi 710121, China;2.Shaanxi Key Laboratory of Network Data Analysis and Intelligent Processing, Xi′an, Shaanxi 710121, China)

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对现有去雾算法的复原图像易出现颜色失真与细节丢失问题,提出了一种基于改进循环生成对抗网络(cycle-consistent generative adversarial networks,CycleGAN)的端到端图像去雾方法,并无需依赖于大气散射模型的约束。网络生成器整体采用Encoder-Decoder架构,同时为有效学习有雾图像与清晰图像间的映射关系,在训练优化目标中结合图像自身属性构建了增强的高频损失与特征损失函数,实现对不同数据域的特征鉴别并进一步保证图像纹理结构。此外为约束复原图像与真实清晰图像颜色的一致性,提出了二阶段学习策略。首先通过非配对数据集对改进CycleGAN进行弱监督训练学习,然后于第二阶段利用部分成对数据集以强监督方式训练正向生成网络,在提高去雾网络稳定性的同时,使复原效果更接近于真实清晰图像风格。实验结果表明,所提去雾方法的峰值信噪比(peak signal to noise ratio,PSNR)和结构相似性(structural similarity,SSIM)指标值相比同类CycleGAN算法分别提升了12.43%与5.53%,并且同其他方法在视觉效果与量化指标的对比结果中也验证了其性能的有效性。

    Abstract:

    Aiming at the problems that the restored images of existing dehazing algorithms are prone to color distortion and details lost,an end-to-end image dehazing method based on cycle-consistent generative adversarial networks (CycleGAN) is proposed,which does not rely on the constriction of atmospheric scattering model.The whole network generator adopts the Encoder-Decoder framework,and in order to effectively learn the mapping relationship between hazy images and clear images,the enhanced high-frequency loss and feature loss functions are constructed in the training optimization objective by combining the image attributes, which realizes the feature identification of different data domains and further ensures the texture structure of images. In addition,a two-stage learning strategy is proposed to constrict the color consistency between restored images and their corresponding clear images.Firstly,the improved CycleGAN is learned by weakly-supervised training with unpaired datasets.Then in the second stage,the forward generator network is trained in a strongly-supervised manner with some paired datasets,which improves the stability of dehazing network while making the restoration effect closer to the real clear image style.The experimental results show that the peak signal to noise ratio (PSNR) and structural similarity (SSIM) of the proposed dehazing method are improved by 12.43% and 5.53%,respectively,compared with the similar CycleGAN algorithm, and the effectiveness of the proposed method is also verified by comparing the results of visual effect and quantitative index with other methods.

    参考文献
    相似文献
    引证文献
引用本文

翟社平,刘园彪,成大宝.结合强监督学习和生成对抗网络的图像去雾[J].光电子激光,2023,34(3):250~259

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2022-04-09
  • 最后修改日期:2022-06-23
  • 录用日期:
  • 在线发布日期: 2023-03-31
  • 出版日期: