高级搜索

留言板

尊敬的读者、作者、审稿人, 关于本刊的投稿、审稿、编辑和出版的任何问题, 您可以本页添加留言。我们将尽快给您答复。谢谢您的支持!

姓名
邮箱
手机号码
标题
留言内容
验证码

基于自适应特征融合和注意力机制的变电设备红外图像识别

王媛彬 吴冰超

王媛彬, 吴冰超. 基于自适应特征融合和注意力机制的变电设备红外图像识别[J]. 电子与信息学报, 2024, 46(9): 3749-3756. doi: 10.11999/JEIT231047
引用本文: 王媛彬, 吴冰超. 基于自适应特征融合和注意力机制的变电设备红外图像识别[J]. 电子与信息学报, 2024, 46(9): 3749-3756. doi: 10.11999/JEIT231047
WANG Yuanbin, WU Bingchao. Infrared Image Recognition of Substation Equipment Based on Adaptive Feature Fusion and Attention Mechanism[J]. Journal of Electronics & Information Technology, 2024, 46(9): 3749-3756. doi: 10.11999/JEIT231047
Citation: WANG Yuanbin, WU Bingchao. Infrared Image Recognition of Substation Equipment Based on Adaptive Feature Fusion and Attention Mechanism[J]. Journal of Electronics & Information Technology, 2024, 46(9): 3749-3756. doi: 10.11999/JEIT231047

基于自适应特征融合和注意力机制的变电设备红外图像识别

doi: 10.11999/JEIT231047
基金项目: 国家自然科学基金(52174198),陕西省重点研发计划(2023 YBSF-133),陕西省秦创原科学家+工程师队伍建设(2022KXJ-166)
详细信息
    作者简介:

    王媛彬:女,博士,副教授,研究方向为电力设备状态检测

    吴冰超:男,硕士生,研究方向为电力设备图像处理

    通讯作者:

    王媛彬 wangyb998@163.com

  • 中图分类号: TN911.73

Infrared Image Recognition of Substation Equipment Based on Adaptive Feature Fusion and Attention Mechanism

Funds: The National Natural Science Foundation of China (52174198), The National Key Research and Development Program of Shaanxi Province (2023 YBSF-133), The Construction of Qinchuangyuan Scientists and Engineers Team in Shaanxi Province (2022KXJ-166)
  • 摘要: 针对变电设备红外图像复杂背景下多目标、小目标及遮挡目标识别效果差的问题,该文提出一种基于中心点网络(CenterNet)的变电设备红外图像识别方法。通过将自适应特征融合模块(ASFF)和特征金字塔(FPN)相结合, 构建ASFF+FPN结构的特征融合网络,增强了模型对多目标和小目标的跨尺度特征融合能力,排除背景信息;针对网络对遮挡目标特征捕捉能力差的问题,在特征融合网络中添加全局注意力机制,增强目标显著度;为实现模型轻量化,引入深度可分离卷积,减少参数量和推理时间;最后,通过引入分布焦点损失函数,克服了原损失函数对遮挡目标敏感性差的问题,提升了模型收敛速度和识别精度。在包含7种红外变电设备图像的自建数据集上进行测试。实验表明该算法与原始算法相比,识别精度提升了3.55%,达到了95.19%,模型参数量仅为32.52M,与4种主流目标识别算法对比,该算法在识别精度和算法复杂度上具有明显优势。
  • 图  1  CenterNet网络结构

    图  2  本文算法结构框架

    图  3  ASFF原理

    图  4  GAM工作原理

    图  5  不同λsize,λoff取值的识别精度

    图  6  评价指标变化曲线

    图  7  识别效果对比图

    表  1  不同设备识别结果(%)

    设备类型精确率召回率mAP0.5
    电流互感器97.8490.0798.53
    电压互感器80.0081.3688.60
    隔离开关96.2699.4599.58
    绝缘子96.5889.4095.56
    避雷器95.8890.7395.15
    套管92.3781.3489.80
    断路器99.4991.6399.09
    所有种类94.0689.1495.19
    下载: 导出CSV

    表  2  消融实验

    方法 ASFF+FPN GAM DSC DFL mAP0.5(%)
    CenterNet × × × × 91.64
    方案1 × × × 92.43
    方案2 × × 93.10
    方案3 × 93.32
    本文方法 95.19
    下载: 导出CSV

    表  3  不同算法对比实验

    算法 mAP0.5 (%) FPS 参数量(M) FLOPs(G)
    Faster R-CNN 94.65 11.84 137.10 370.21
    SSD 91.92 76.73 36.28 72.75
    YOLOv5 91.50 87.50 47.06 115.91
    YOLOv7 88.04 36.54 37.62 106.47
    CenterNet 91.64 61.93 32.67 70.21
    本文算法 95.19 65.32 32.52 69.28
    下载: 导出CSV

    表  4  泛化性实验mAP0.5结果(%)

    识别类型 缺陷绝缘子 正常绝缘子 所有种类
    CenterNet 90.26 92.53 91.40
    本文算法 93.69 96.45 95.07
    下载: 导出CSV
  • [1] LI Jianqi, XU Yaqian, NIE Keheng, et al. PEDNet: A lightweight detection network of power equipment in infrared image based on YOLOv4-Tiny[J]. IEEE Transactions on Instrumentation and Measurement, 2023, 72: 5004312. doi: 10.1109/tim.2023.3235416.
    [2] XIA Changjie, REN Ming, WANG Bing, et al. Infrared thermography-based diagnostics on power equipment: State-of-the-art[J]. High Voltage, 2021, 6(3): 387–407. doi: 10.1049/hve2.12023.
    [3] REN Shaoqing, HE Kaiming, GIRSHICK R, et al. Faster R-CNN: Towards real-time object detection with region proposal network[C]. The 28th International Conference on Neural Information Processing Systems, Montreal, Canada, 2015: 91–99.
    [4] OU Jianhua, WANG Jianguo, XUE Jian, et al. Infrared image target detection of substation electrical equipment using an improved faster R-CNN[J]. IEEE Transactions on Power Delivery, 2023, 38(1): 387–396. doi: 10.1109/tpwrd.2022.3191694.
    [5] 王妤, 陈秀新, 袁和金. 基于改进Faster RCNN的变电站红外图像多目标识别[J]. 传感技术学报, 2021, 34(4): 522–530. doi: 10.3969/j.issn.1004-1699.2021.04.014.

    WANG Yu, CHEN Xiuxin, and YUAN Hejin. Multi-target recognition of substation infrared image based on improved Faster RCNN[J]. Chinese Journal of Sensors and Actuators, 2021, 34(4): 522–530. doi: 10.3969/j.issn.1004-1699.2021.04.014.
    [6] LIU Wei, ANGUELOV D, ERHAN D, et al. SSD: Single shot MultiBox detector[C]. The 14th European Conference on Computer Vision, Amsterdam, The Netherlands, 2016: 21–37. doi: 10.1007/978-3-319-46448-0_2.
    [7] REDMON J, DIVVALA S, GIRSHICK R, et al. You only look once: Unified, real-time object detection[C]. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, USA, 2016: 779–788. doi: 10.1109/CVPR.2016.91.
    [8] 王旭红, 李浩, 樊绍胜, 等. 基于改进SSD的电力设备红外图像异常自动检测方法[J]. 电工技术学报, 2020, 35(S1): 302–310. doi: 10.19595/j.cnki.1000-6753.tces.l80426.

    WANG Xuhong, LI Hao, FAN Shaosheng, et al. Infrared image anomaly automatic detection method for power equipment based on improved single shot multi box detection[J]. Transactions of China Electrotechnical Society, 2020, 35(S1): 302–310. doi: 10.19595/j.cnki.1000-6753.tces.l80426.
    [9] 谭宇璇, 樊绍胜. 基于图像增强与深度学习的变电设备红外热像识别方法[J]. 中国电机工程学报, 2021, 41(23): 7990–7997. doi: 10.13334/j.0258-8013.pcsee.202487.

    TAN Yuxuan and FAN Shaosheng. Infrared thermal image recognition of substation equipment based on image enhancement and deep learning[J]. Proceedings of the CSEE, 2021, 41(23): 7990–7997. doi: 10.13334/j.0258-8013.pcsee.202487.
    [10] 王媛彬, 李媛媛, 段誉, 等. 基于轻量骨干网络和注意力结构的变电设备红外图像识别[J]. 电网技术, 2023, 47(10): 4358–4369. doi: 10.13335/j.1000-3673.pst.2022.2113.

    WANG Yuanbin, LI Yuanyuan, DUAN Yu, et al. Infrared image recognition of substation equipment based on lightweight backbone network and attention mechanism[J]. Power System Technology, 2023, 47(10): 4358–4369. doi: 10.13335/j.1000-3673.pst.2022.2113.
    [11] DUAN Kaiwen, BAI Song, XIE Lingxi, et al. CenterNet: Keypoint triplets for object detection[C]. 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea (South), 2019: 6568–6577. doi: 10.1109/iccv.2019.00667.
    [12] 黄悦华, 杨楚睿, 陈晨, 等. 基于改进Centernet的变电设备红外检测方法[J]. 电子测量技术, 2023, 46(4): 142–148. doi: 10.19651/j.cnki.emt.2210406.

    HUANG Yuehua, YANG Churui, CHEN Chen, et al. Infrared detection method of substation equipment based on improved Centernet[J]. Electronic Measurement Technology, 2023, 46(4): 142–148. doi: 10.19651/j.cnki.emt.2210406.
    [13] ZHENG Hanbo, CUI Yaohui, FAN Xianhao, et al. An infrared image detection method of substation equipment combining Iresgroup structure and CenterNet[J]. IEEE Transactions on Power Delivery, 2022, 37(6): 4757–4765. doi: 10.1109/tpwrd.2022.3158818.
    [14] CHENG Xun and YU Jianbo. RetinaNet with difference channel attention and adaptively spatial feature fusion for steel surface defect detection[J]. IEEE Transactions on Instrumentation and Measurement, 2021, 70: 2503911. doi: 10.1109/tim.2020.3040485.
    [15] LI Yuancheng, ZHOU Shenglong, CHEN Hui, et al. Attention-based fusion factor in FPN for object detection[J]. Applied Intelligence, 2022, 52(13): 15547–15556. doi: 10.1007/s10489-022-03220-0.
    [16] NIU Zhaoyang, ZHONG Guoqiang, and YU Hui. A review on the attention mechanism of deep learning[J]. Neurocomputing, 2021, 452: 48–62. doi: 10.1016/j.neucom.2021.03.091.
    [17] 谢雯, 王若男, 羊鑫, 等. 融合深度可分离卷积的多尺度残差UNet在PolSAR地物分类中的研究[J]. 电子与信息学报, 2023, 45(8): 2975–2985. doi: 10.11999/JEIT220867.

    XIE Wen, WANG Ruonan, YANG Xin, et al. Research on multi-scale residual UNet fused with depthwise separable convolution in PolSAR terrain classification[J]. Journal of Electronics & Information Technology, 2023, 45(8): 2975–2985. doi: 10.11999/JEIT220867.
    [18] LI Feng, ZURADA J M, and WU Wei. Smooth group L1/2 regularization for input layer of feedforward neural networks[J]. Neurocomputing, 2018, 314: 109–119. doi: 10.1016/j.neucom.2018.06.046.
    [19] 康守强, 杨佳轩, 王玉静, 等. 基于改进宽度模型迁移学习的不同负载下滚动轴承状态快速分类方法[J]. 电子与信息学报, 2023, 45(5): 1824–1832. doi: 10.11999/JEIT220401.

    KANG Shouqiang, YANG Jiaxuan, WANG Yujing, et al. A fast classification method of rolling bearing state under different loads based on improved broad model transfer learning[J]. Journal of Electronics & Information Technology, 2023, 45(5): 1824–1832. doi: 10.11999/JEIT 220401.
  • 加载中
图(7) / 表(4)
计量
  • 文章访问数:  226
  • HTML全文浏览量:  150
  • PDF下载量:  39
  • 被引次数: 0
出版历程
  • 收稿日期:  2023-09-27
  • 修回日期:  2023-12-03
  • 网络出版日期:  2023-12-14
  • 刊出日期:  2024-09-26

目录

    /

    返回文章
    返回