自监督解耦动态分类器的小样本类增量SAR图像目标识别

赵琰; 赵凌君; 张思乾; 计科峰; 匡纲要

doi:10.11999/JEIT231470

自监督解耦动态分类器的小样本类增量SAR图像目标识别

doi: 10.11999/JEIT231470

国防科技大学电子科学学院长沙 410073

详细信息

作者简介:
赵琰：男，博士生，研究方向为SAR图像目标识别、增量学习、小样本学习

赵凌君：女，博士，副教授，研究方向为遥感信息处理、SAR图像目标识别

张思乾：女，博士，副教授，研究方向为遥感信息处理、SAR图像目标识别

计科峰：男，博士，教授，研究方向为SAR目标电磁散射特性建模、特征提取、检测识别

匡纲要：男，博士，教授，研究方向为遥感信息处理、SAR图像目标识别

通讯作者:
赵凌君　nudtzlj@163.com

中图分类号: TN957; TP751.2
计量
- 文章访问数: 240
- HTML全文浏览量: 237
- PDF下载量: 80
- 被引次数: 0
出版历程
- 收稿日期: 2024-01-10
- 修回日期: 2024-06-17
- 网络出版日期: 2024-06-24
- 刊出日期: 2024-10-30

Few-Shot Class-Incremental SAR Image Target Recognition using Self-supervised Decoupled Dynamic Classifier

College of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, China

摘要

摘要: 为提升基于深度学习(DL)的合成孔径雷达自动目标识别(SAR ATR)系统在开放动态的非合作场景中对新类别目标的持续敏捷识别能力，该文研究了SAR ATR的小样本类增量学习(FSCIL)问题，并提出了自监督解耦动态分类器(SDDC)。针对FSCIL 中“灾难性遗忘”和“过拟合”本质难点和SAR ATR领域挑战，根据SAR图像目标信息的部件化与方位角敏感性特点，于图像域构建了基于散射部件混淆与旋转模块(SCMR)的自监督学习任务，以提升目标表征的泛化性与稳健性。同时，设计了类印记交叉熵(CI-CE)损失并以参数解耦学习(PDL)策略对模型动态微调，以对新旧知识平衡判别。实验在由MSTAR和SAR-AIRcraft-1.0数据集分别构建的覆盖多种目标类别、观测条件和成像平台的FSCIL场景上验证了该算法开放动态环境的适应能力。
- SAR目标识别 /
- 小样本类增量学习 /
- 自监督学习 /
- 深度学习
Abstract: To power Deep-Learning (DL) based Synthetic Aperture Radar Automatic Target Recognition (SAR ATR) systems with the capability of learning new-class targets incrementally and rapidly in openly dynamic non-cooperative situations, the problem of Few-Shot Class-Incremental Learning (FSCIL) of SAR ATR is researched and a Self-supervised Decoupled Dynamic Classifier (SDDC) is proposed. Considering solving both the intrinsic Catastrophic forgetting and Overfitting dilemma of the FSCIL and domain challenges of SAR ATR, a self-supervised learning task powered by Scattering Component Mixup and Rotation (SCMR) is designed to improve the model’s generalizability and stability for target representation, leveraged by the partiality and azimuth dependence of target information in SAR imagery. Meanwhile, a Class-Imprinting Cross-Entropy (CI-CE) and a Parameter Decoupled Learning (PDL) strategy are designed to fine-tune networks dynamically to identify old and new targets evenly. Experiments on various FSCIL scenarios constructed by the MSTAR and the SAR-AIRcraft-1.0 datasets covering diverse target categories, observing environments, and imaging payloads, verify the method’s adaptability to openly dynamic world.
- SAR target recognition /
- Few-Shot Class-Incremental Learning(FSCIL) /
- Self-supervised learning /
- Deep Learning(DL)

HTML全文

图 1 自监督动态解耦分类器(SDDC)整体结构

下载: 全尺寸图片幻灯片

图 2 SAR图像目标结构与高维语义信息的方位角敏感性与相位模糊性

下载: 全尺寸图片幻灯片

图 3 基于误差解耦理论对类印记初始化优势分析

下载: 全尺寸图片幻灯片

图 4 FSCIL数据集构建过程

下载: 全尺寸图片幻灯片

图 5 MSTAR数据集10类目标SAR图像与光学图像对比

下载: 全尺寸图片幻灯片

图 6 SAR-AIRcarft-1.0数据集7类目标SAR图像与光学图像对比

下载: 全尺寸图片幻灯片

图 7 SMO对算法特征提取能力改善可视化结果

下载: 全尺寸图片幻灯片

图 8 采用SMO前后算法所提目标梯度激活图与特征稀疏性与响应值

下载: 全尺寸图片幻灯片

图 9 采用SRO前后算法所提目标方位角特征归一化值与梯度激活图

下载: 全尺寸图片幻灯片

图 10 采用SRO前后算法所提类内特征相似性均值与方差

下载: 全尺寸图片幻灯片

图 11 算法分类准确率与归一化分类器值。

下载: 全尺寸图片幻灯片

图 12 PDL不同解耦阶段对算法在多种评价指标上分类性能影响的柱状图

下载: 全尺寸图片幻灯片

图 13 算法不同解耦位置对基类和增量类目标的梯度激活图

下载: 全尺寸图片幻灯片

图 14 不同算法在MSTAR-FSCIL数据集和SAR-AIRcraft-1.0-FSCIL数据集测试性能曲线图

下载: 全尺寸图片幻灯片

图 15 对比基准分类结果混淆矩阵

下载: 全尺寸图片幻灯片

图 16 不同学习阶段MSTAR-FSCIL数据集类特征空间t-SNE分布

下载: 全尺寸图片幻灯片

图 17 不同学习阶段SAR-AIRcraft-1.0-FSCIL数据集类特征空间t-SNE分布

下载: 全尺寸图片幻灯片

1 散射混淆操作(SMO)处理过程

输入：小批次基类训练样本 ${\boldsymbol{b}} = \{ ({{\boldsymbol{x}}_i},{y_i})\} _{i = 1}^{\|{N_{{b}}}\|} \in {{\boldsymbol{D}}^1}$
初始化：混淆次数 R ，混淆样本存储列表${S_{{\text{smo}}}}$
For r = 1 to R do
步骤1　采样随机顺序数据${\boldsymbol{\tilde b}} = \{ ({{\boldsymbol{\tilde x}}_i},{\tilde y_i})\} _{i = 1}^{\|{N_{{b}}}\|}$
步骤2　获取原始$\{ {y_i}\} _{i = 1}^{\|{N_{{b}}}\|}$与随机顺序$\{ {\tilde y_i}\} _{i = 1}^{\|{N_{{b}}}\|}$标签
步骤3　从${\boldsymbol{b}}$中选取${\boldsymbol{b}}' = \{ ({{\boldsymbol{x}}'_i},{y'_i})\} $，从${\boldsymbol{\tilde b}}$中选取　　　　　 $ {\boldsymbol{\tilde b}}' = \{ ({{\boldsymbol{\tilde x}}'_i},{\tilde y'_i})\} $，满足${y'_j} \ne {\tilde y'_j},\forall j \in \|{N_{{b}}}\|$
步骤4　根据式(1)从${\boldsymbol{b}}'$与 $ {\boldsymbol{\tilde b}}' $中生成散射混淆样本集　　　　　 $ {{\stackrel \frown{{\boldsymbol{b}}} }} = \{ ({{{\stackrel \frown{{\boldsymbol{x}}} }}_i},{\stackrel \frown{y} _i})\} $
步骤5　将$ {{\stackrel \frown{{\boldsymbol{b}}} }} $添加至${S_{{\text{smo}}}}$
End for
输出：${S_{{\text{smo}}}}$

下载: 导出CSV

表 1 MSTAR-FSCIL数据集配置

学习阶段	序号	类别	型号	训练集	测试集
基类	1	BTR70	c71	233	196
	2	2S1	b01	299	274
	3	BRDM2	E-71	298	274
	4	BMP2	9563	233	196
增量类	5	ZIL131	E12	5	274
	6	T62	A51	5	274
	7	D7	13015	5	274
	8	BTR60	7532	5	195
	9	T72	132	5	196
	10	ZSU234	d08	5	274

下载: 导出CSV

表 2 SAR-AIRcraft-1.0-FSCIL数据集配置表

学习阶段	序号	类别	训练集	测试集
基类	1	Other	2 000	200
	2	A220	2 000	200
	3	Boeing787	2 000	200
	4	Boeing737	2 000	200
增量类	5	A320	5	200
	6	ARJ21	5	200
	7	A330	5	200

下载: 导出CSV

表 3 SDDC算法模块与损失贡献(%)

迁移性		判别性		Avg.Acc	Acc.Old	Acc.New	PD
SMO	SRO	CI-CE	PDL	Avg.Acc	Acc.Old	Acc.New	PD
				75.26	78.87	49.02	41.50
√				78.35	81.41	54.16	37.77
	√			77.79	81.27	52.24	35.29
√	√			79.50	82.68	54.46	34.47
√	√	√		73.30	72.62	79.12	55.83
√	√		√	75.81	79.01	47.22	42.35
√	√	√	√	81.73	83.37	66.70	31.61

下载: 导出CSV

参考文献(18)

[1]	张路, 廖明生, 董杰, 等. 基于时间序列InSAR分析的西部山区滑坡灾害隐患早期识别——以四川丹巴为例[J]. 武汉大学学报: 信息科学版, 2018, 43(12): 2039–2049. doi: 10.13203/j.whugis20180181. ZHANG Lu, LIAO Mingsheng, DONG Jie, et al. Early detection of landslide hazards in mountainous areas of West China using time series SAR interferometry-A case study of Danba, Sichuan[J]. Geomatics and Information Science of Wuhan University, 2018, 43(12): 2039–2049. doi: 10.13203/j.whugis20180181.
[2]	李永祯, 黄大通, 邢世其, 等. 合成孔径雷达干扰技术研究综述[J]. 雷达学报, 2020, 9(5): 753–764. doi: 10.12000/JR20087. LI Yongzhen, HUANG Datong, XING Shiqi, et al. A review of synthetic aperture radar jamming technique[J]. Journal of Radars, 2020, 9(5): 753–764. doi: 10.12000/JR20087.
[3]	傅兴玉, 尤红建, 付琨. 基于邻域均方连续差分的SAR图像边缘提取算法[J]. 电子与信息学报, 2012, 34(5): 1030–1037. doi: 10.3724/SP.J.1146.2011.00920. FU Xingyu, YOU Hongjian, and FU Kun. An approach to extract edge in SAR image based on square successive difference of neighborhood averages[J]. Journal of Electronics & Information Technology, 2012, 34(5): 1030–1037. doi: 10.3724/SP.J.1146.2011.00920.
[4]	罗汝, 赵凌君, 何奇山, 等. SAR图像飞机目标智能检测识别技术研究进展与展望[J]. 雷达学报, 2024, 13(2): 307–330. doi: 10.12000/JR23056. LUO Ru, ZHAO Lingjun, HE Qishan, et al. Intelligent technology for aircraft detection and recognition through SAR imagery: Advancements and prospects[J]. Journal of Radars, 2024, 13(2): 307–330. doi: 10.12000/JR23056.
[5]	周大蔚, 汪福运, 叶翰嘉, 等. 基于深度学习的类别增量学习算法综述[J]. 计算机学报, 2023, 46(8): 1577–1605. doi: 10.11897/SP.J.1016.2023.01577. ZHOU Dawei, WANG Fuyun, YE Hanjia, et al. Deep learning for class-incremental learning: A survey[J]. Chinese Journal of Computers, 2023, 46(8): 1577–1605. doi: 10.11897/SP.J.1016.2023.01577.
[6]	丁柏圆, 文贡坚, 余连生, 等. 属性散射中心匹配及其在SAR目标识别中的应用[J]. 雷达学报, 2017, 6(2): 157–166. doi: 10.12000/JR16104. DING Baiyuan, WEN Gongjian, YU Liansheng, et al. Matching of attributed scattering center and its application to synthetic aperture radar automatic target recognition[J]. Journal of Radars, 2017, 6(2): 157–166. doi: 10.12000/JR16104.
[7]	HUMMEL R. Model-based ATR using synthetic aperture radar[C]. The IEEE 2000 International Radar Conference, Alexandria, USA, 2000: 856–861. doi: 10.1109/RADAR.2000.851947.
[8]	CHEN Sizhe, WANG Haipeng, XU Feng, et al. Target classification using the deep convolutional networks for SAR images[J]. IEEE Transactions on Geoscience and Remote Sensing, 2016, 54(8): 4806–4817. doi: 10.1109/TGRS.2016.2551720.
[9]	REBUFFI S A, KOLESNIKOV A, SPERL G, et al. iCaRL: Incremental classifier and representation learning[C]. 2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, USA, 2017: 5533–5542. doi: 10.1109/CVPR.2017.587.
[10]	HOU Saihui, PAN Xinyu, LOY C C, et al. Learning a unified classifier incrementally via rebalancing[C]. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, USA, 2019: 831–839. doi: 10.1109/CVPR.2019.00092.
[11]	TAO Xiaoyu, HONG Xiaopeng, CHANG Xinyuan, et al. Few-shot class-incremental learning[C]. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, USA, 2020: 12180–12189. doi: 10.1109/cvpr42600.2020.01220.
[12]	ZHANG Chi, SONG Nan, LIN Guosheng, et al. Few-shot incremental learning with continually evolved classifiers[C]. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, USA, 2021: 12450–12459. doi: 10.1109/CVPR46437.2021.01227.
[13]	PENG Can, ZHAO Kun, WANG Tianren, et al. Few-shot class-incremental learning from an open-set perspective[C]. 17th European Conference on Computer Vision, Tel Aviv, Israel, 2022: 382–397. doi: 10.1007/978-3-031-19806-9_22.
[14]	SONG Zeyin, ZHAO Yifan, SHI Yujun, et al. Learning with fantasy: Semantic-aware virtual contrastive constraint for few-shot class-incremental learning[C]. 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, Canada, 2023: 24183–24192. doi: 10.1109/CVPR52729.2023.02316.
[15]	WANG Li, YANG Xinyao, TAN Haoyue, et al. Few-shot class-incremental SAR target recognition based on hierarchical embedding and incremental evolutionary network[J]. IEEE Transactions on Geoscience and Remote Sensing, 2023, 61: 5204111. doi: 10.1109/TGRS.2023.3248040.
[16]	ZHAO Yan, ZHAO Lingjun, DING Ding, et al. Few-shot class-incremental SAR target recognition via cosine prototype learning[J]. IEEE Transactions on Geoscience and Remote Sensing, 2023, 61: 5212718. doi: 10.1109/TGRS.2023.3298016.
[17]	NOVAK L M, OWIRKA G J, BROWER W S, et al. The automatic target-recognition system in SAIP[J]. The Lincoln Laboratory Journal, 1997, 10(2): 187–202.
[18]	王智睿, 康玉卓, 曾璇, 等. SAR-AIRcraft-1.0: 高分辨率SAR飞机检测识别数据集[J]. 雷达学报, 2023, 12(4): 906–922. doi: 10.12000/JR23043. WANG Zhirui, KANG Yuzhuo, ZENG Xuan, et al. SAR-AIRcraft-1.0: High-resolution SAR aircraft detection and recognition dataset[J]. Journal of Radars, 2023, 12(4): 906–922. doi: 10.12000/JR23043.