高级搜索

留言板

尊敬的读者、作者、审稿人, 关于本刊的投稿、审稿、编辑和出版的任何问题, 您可以本页添加留言。我们将尽快给您答复。谢谢您的支持!

姓名
邮箱
手机号码
标题
留言内容
验证码

多尺度超像素纹理特征保持与融合的高光谱图像分类

涂兵 朱禹 周承乐 陈思源 何伟

涂兵, 朱禹, 周承乐, 陈思源, 何伟. 多尺度超像素纹理特征保持与融合的高光谱图像分类[J]. 电子与信息学报, 2022, 44(6): 2207-2215. doi: 10.11999/JEIT210333
引用本文: 涂兵, 朱禹, 周承乐, 陈思源, 何伟. 多尺度超像素纹理特征保持与融合的高光谱图像分类[J]. 电子与信息学报, 2022, 44(6): 2207-2215. doi: 10.11999/JEIT210333
TU Bing, ZHU Yu, ZHOU Chengle, CHEN Siyuan, HE Wei. Hyperspectral Image Classification Based on Multi-scale Superpixel Texture Preservation and Fusion[J]. Journal of Electronics & Information Technology, 2022, 44(6): 2207-2215. doi: 10.11999/JEIT210333
Citation: TU Bing, ZHU Yu, ZHOU Chengle, CHEN Siyuan, HE Wei. Hyperspectral Image Classification Based on Multi-scale Superpixel Texture Preservation and Fusion[J]. Journal of Electronics & Information Technology, 2022, 44(6): 2207-2215. doi: 10.11999/JEIT210333

多尺度超像素纹理特征保持与融合的高光谱图像分类

doi: 10.11999/JEIT210333
基金项目: 国家自然科学基金(51704115),湖南省杰出青年科学基金(2020JJ2017),湖南省水利厅重大科技项目(XSKJ2021000-12),湖南省重点领域研究计划(2019SK2012),湖南省自然科学基金(2019JJ50211, 2019JJ50212, 2020JJ4340, 2021JJ40226),湖南省教育厅优秀青年基金(19B245, 19B237, 20B257, 20B266),湖南省水利厅一般科研项目(XSKJ2021000-13)。
详细信息
    作者简介:

    涂兵:男,1983年生,教授,研究方向为高光谱遥感图像处理、深度学习

    朱禹:女,1996年生,硕士生,研究方向为高光谱遥感图像分类、多源遥感数据融合

    周承乐:男,1994年生,硕士生,研究方向为机器学习、高光谱遥感图像分类

    陈思源:男,1990年生,讲师,研究方向为数字图像处理、3D重建

    何伟:男,1983年生,副教授,研究方向为数字图像处理、计算机视觉

    通讯作者:

    陈思源 siyuan@hnist.edu.cn

  • 中图分类号: TN911.73; TP751

Hyperspectral Image Classification Based on Multi-scale Superpixel Texture Preservation and Fusion

Funds: The National Natural Science Foundation of China (51704115), Science Foundation for Distinguished Young Scholars of Hunan Province (2020JJ2017), Foundation of Department of Water Resources of Hunan Province (XSKJ2021000-12), Key Research and Development Program of Hunan Province (2019SK2012), Natural Science Foundation of Hunan Province (2019JJ50211, 2019JJ50212, 2020JJ4340, 2021JJ40226), Foundation of Education Bureau of Hunan Province (19B245, 19B237, 20B257, 20B266), Foundation of Department of Water Resources of Hunan Province (XSKJ2021000-13).
  • 摘要: 高光谱图像的低空间分辨率特性往往导致全局纹理提取技术难以获取地物要素的精准纹理信息,同时,单一尺度的局部纹理提取技术难以达到有效识别地物的目的。基于此,该文设计了一种多尺度超像素纹理保持与融合(MSuTPF)的高光谱图像分类方法,主要架构如下:首先,利用2D Gabor滤波器对高光谱图像进行多方向与尺度的全局纹理提取,并通过融合各尺度的纹理特征,增强纹理结构表征能力;其次,融合纹理与光谱主成分特征以形成光谱-纹理联合判别特征;再次,采用形状自适应的超分割方法,作用至光谱-纹理联合特征进行局部纹理信息保持与融合,尤其是,为克服超像素邻域像元的隐性不相关问题,该文定义了基于密度最近邻相似性评价准则,使超像素纹理进一步趋于一致性;最后,将各更新的光谱-纹理联合特征输入像素级分类器获取其对应的类标签,并采用多数表决的决策融合机制取得最终分类结果。Indian Pines和Pavia University真实数据集的实验表明,该方法在小样本条件下的分类精度优于基准分类器(SVM)、深度学习方法(GFDN)以及最新的空-谱分类方法(S3-PCA)等8个对比方法,充分证明了该文所提方法的实用性和有效性。
  • 图  1  多尺度超像素纹理保持与融合的高光谱图像分类方法示意图

    图  2  Indian Pines高光谱图像不同方法的分类图

    图  3  Pavia University高光谱图像不同方法的分类图

    图  4  不同参数对所提算法性能的影响

    图  5  不同滤波方法的整体分类效果

    图  6  不同训练样本数量对于不同方法的影响

    表  1  Indian Pines高光谱图像不同方法的分类精度(%)

    客观指标训练样本测试样本高光谱图像分类算法(部分经典的、主流的与最新的)
    SVMSRCJSRCSC-MKSuperPCAHiFi-weGFDNS3-PCAMSuTPF*MSuTPF
    OA占比1.5%占比98.5%65.0763.0378.4687.3685.5588.0289.9788.2392.3994.32
    (1.66)(1.73)(1.90)(2.47)(2.42)(1.41)(1.57)(2.00)(1.21)(0.77)
    AA62.5567.5780.5089.6075.1382.8789.3086.4994.1995.00
    (2.10)(1.67)(2.68)(2.83)(2.18)(2.29)(1.92)(2.31)(1.44)(1.99)
    Kappa59.9357.9575.4085.6085.6086.3988.5888.7591.3293.52
    (1.83)(1.97)(2.18)(2.83)(2.73)(1.58)(1.78)(1.70)(1.38)(0.88)
    下载: 导出CSV

    表  2  Pavia University高光谱图像不同方法的分类精度(%)

    客观指标训练样本测试样本高光谱图像分类算法(部分经典的、主流的与最新的)
    SVMSRCJSRCSC-MKSuperPCAHiFi-weGFDNS3-PCAMSuTPF*MSuTPF
    OA占比0.42%占比99.58%82.6574.5578.2894.4993.2190.5993.2385.9994.5495.57
    (1.81)(1.25)(1.27)(1.07)(1.92)(1.26)(0.87)(1.40)(0.80)(1.07)
    AA80.0470.4869.1191.3989.1588.6490.4781.2294.2895.86
    (2.41)(2.05)(1.38)(1.57)(2.06)(1.71)(1.37)(1.91)(1.28)(0.95)
    Kappa76.7365.6670.7492.6792.2787.4690.9281.2292.7294.08
    (2.47)(1.75)(1.68)(1.43)(1.88)(1.68)(1.19)(1.54)(1.07)(1.44)
    下载: 导出CSV

    表  3  采用不同的2D-Gabor和ERS超像素分割处理方法在Indian Pines高光谱图像上的分类效果

    指标I-GaborII-GaborIII-GaborI-ERSII-ERS
    OA(%)92.89(1.37)93.79(2.03)94.32(0.77)93.68(0.91)94.32(0.77)
    AA(%)93.84(1.63)95.11(1.35)95.00(1.99)93.14(2.97)95.00(1.99)
    Kappa91.88(1.55)92.93(2.3)93.32(0.88)92.79(1.04)93.32(0.88)
    下载: 导出CSV

    表  4  不同维数光谱特征对算法性能的影响

    真实数据集光谱特征维数
    5101520253035
    Indian PinesOA(%)93.2793.9894.2394.3293.6492.9192.47
    Kappa0.92560.93310.93570.93520.92850.92260.9163
    Pavia UniversityOA(%)94.3994.8695.1495.5795.4295.2194.83
    Kappa0.92870.93320.93910.94080.94940.94800.9331
    下载: 导出CSV
  • [1] PRASAD S and BRUCE L M. Limitations of principal components analysis for hyperspectral target recognition[J]. IEEE Geoscience and Remote Sensing Letters, 2008, 5(4): 625–629. doi: 10.1109/LGRS.2008.2001282
    [2] 罗甫林, 黄鸿, 刘嘉敏, 等. 基于半监督稀疏流形嵌入的高光谱影像特征提取[J]. 电子与信息学报, 2016, 38(9): 2321–2329. doi: 10.11999/JEIT151340

    LUO Fulin, HUANG Hong, LIU Jiamin, et al. Feature extraction of hyperspectral image using semi-supervised sparse manifold embedding[J]. Journal of Electronics &Information Technology, 2016, 38(9): 2321–2329. doi: 10.11999/JEIT151340
    [3] CHEN Yi, NASRABADI N M, and TRAN T D. Hyperspectral image classification using dictionary-based sparse representation[J]. IEEE Transactions on Geoscience and Remote Sensing, 2011, 49(10): 3973–3985. doi: 10.1109/TGRS.2011.2129595
    [4] YU Haoyang, GAO Lianru, LIAO Wenzhi, et al. Multiscale superpixel-level subspace-based support vector machines for hyperspectral image classification[J]. IEEE Geoscience and Remote Sensing Letters, 2017, 14(11): 2142–2146. doi: 10.1109/LGRS.2017.2755061
    [5] TU Bing, ZHOU Chengle, LIAO Xiaolong, et al. Feature extraction via 3-D block characteristics sharing for hyperspectral image classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 2020, 59(12): 10503–10518. doi: 10.1109/TGRS.2020.3042274
    [6] TU Bing, ZHOU Chengle, PENG Jin, et al. Feature extraction via joint adaptive structure density for hyperspectral imagery classification[J]. IEEE Transactions on Instrumentation and Measurement, 2021, 70: 5006916. doi: 10.1109/TIM.2020.3038557
    [7] 李光, 姜春雪, 刘争战, 等. Laws纹理能量结合灰度共生矩阵的遥感影像面状地物提取[J]. 测绘与空间地理信息, 2017, 40(7): 179–181,185. doi: 10.3969/j.issn.1672-5867.2017.07.057

    LI Guang, JIANG Chunxue, LIU Zhengzhan, et al. Polygon feature extraction of remote sensing image based on laws texture energy and gray level co-occurrence matrix[J]. Geomatics &Spatial Information Technology, 2017, 40(7): 179–181,185. doi: 10.3969/j.issn.1672-5867.2017.07.057
    [8] JIA Sen, HU Jie, DENG Lin, et al. Fuzzy threshold-based uniform local binary patterns for hyperspectral imagery classification[C]. 2016 8th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS), Los Angeles, USA, 2016: 1–4. doi: 10.1109/WHISPERS.2016.8071771.
    [9] XU Yan, DU Qian, LI Wei, et al. . Gabor-filtering-based probabilistic collaborative representation for hyperspectral image classification[C]. IGARSS 2018-2018 IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain, 2018: 5081–5084. doi: 10.1109/IGARSS.2018.8517805.
    [10] KANG Xudong, LI Chengchao, LI Shutao, et al. Classification of hyperspectral images by Gabor filtering based deep network[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2018, 11(4): 1166–1178. doi: 10.1109/JSTARS.2017.2767185
    [11] LIU Chengjun and WECHSLER H. Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition[J]. IEEE Transactions on Image Processing, 2002, 11(4): 467–476. doi: 10.1109/TIP.2002.999679
    [12] TU Bing, ZHOU Chengle, LIAO Xiaolong, et al. Spectral-spatial hyperspectral classification via structural-kernel collaborative representation[J]. IEEE Geoscience and Remote Sensing Letters, 2021, 18(5): 861–865. doi: 10.1109/LGRS.2020.2988124
    [13] WANG Xinyu, ZHONG Yanfei, ZHANG Liangpei, et al. Spatial group sparsity regularized nonnegative matrix factorization for hyperspectral unmixing[J]. IEEE Transactions on Geoscience and Remote Sensing, 2017, 55(11): 6287–6304. doi: 10.1109/TGRS.2017.2724944
    [14] LIU Mingyu, TUZEL O, RAMALINGAM S, et al. Entropy-rate clustering: Cluster analysis via maximizing a submodular function subject to a matroid constraint[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014, 36(1): 99–112. doi: 10.1109/TPAMI.2013.107
    [15] MELGANI F and BRUZZONE L. Classification of hyperspectral remote sensing images with support vector machines[J]. IEEE Transactions on Geoscience and Remote Sensing, 2004, 42(8): 1778–1790. doi: 10.1109/TGRS.2004.831865
    [16] FANG Leyuan, LI Shutao, DUAN Wuhui, et al. Classification of hyperspectral images by exploiting spectral-spatial information of superpixel via multiple kernels[J]. IEEE Transactions on Geoscience and Remote Sensing, 2015, 53(12): 6663–6674. doi: 10.1109/TGRS.2015.2445767
    [17] JIANG Junjun, MA Jiayi, CHEN Chen, et al. SuperPCA: A superpixelwise PCA approach for unsupervised feature extraction of hyperspectral imagery[J]. IEEE Transactions on Geoscience and Remote Sensing, 2018, 56(8): 4581–4593. doi: 10.1109/TGRS.2018.2828029
    [18] PAN Bin, SHI Zhenwei, and XU Xia. Hierarchical guidance filtering-based ensemble classification for hyperspectral images[J]. IEEE Transactions on Geoscience and Remote Sensing, 2017, 55(7): 4177–4189. doi: 10.1109/TGRS.2017.2689805
    [19] ZHANG Xin, JIANG Xinwei, JIANG Junjun, et al. . Spectral-spatial and superpixelwise PCA for unsupervised feature extraction of hyperspectral imagery[J]. IEEE Transactions on Geoscience and Remote Sensing, To be published. doi: 10.1109/TGRS.2021.3057701.
    [20] KANG Xudong, LI Shutao, and BENEDIKTSSON J A. Feature extraction of hyperspectral images with image fusion and recursive filtering[J]. IEEE Transactions on Geoscience and Remote Sensing, 2014, 52(6): 3742–3752. doi: 10.1109/TGRS.2013.2275613
    [21] 宁鸿章, 谭鑫, 李宇航, 等. 空-谱维联合Savitzky-Golay高光谱滤波算法及其应用[J]. 光谱学与光谱分析, 2020, 40(12): 3699–3704. doi: 10.3964/j.issn.1000-0593(2020)12-3699-06

    NING Hongzhang, TAN Xin, LI Yuhang, et al. Joint space-spectrum sg filtering algorithms for hyperspectral images and its application[J]. Spectroscopy and Spectral Analysis, 2020, 40(12): 3699–3704. doi: 10.3964/j.issn.1000-0593(2020)12-3699-06
    [22] CHEN Zhikun, JIANG Junjun, ZHOU Chong, et al. SuperBF: Superpixel-based bilateral filtering algorithm and its application in feature extraction of hyperspectral images[J]. IEEE Access, 2019, 7: 147796–147807. doi: 10.1109/ACCESS.2019.2938397
    [23] JAIN A and GUPTA R. Gaussian filter threshold modulation for filtering flat and texture area of an image[C]. 2015 International Conference on Advances in Computer Engineering and Applications, Ghaziabad, India, 2015: 760–763. doi: 10.1109/ICACEA.2015.7164804.
  • 加载中
图(6) / 表(4)
计量
  • 文章访问数:  1167
  • HTML全文浏览量:  608
  • PDF下载量:  157
  • 被引次数: 0
出版历程
  • 收稿日期:  2021-04-20
  • 修回日期:  2021-09-15
  • 网络出版日期:  2021-09-28
  • 刊出日期:  2022-06-21

目录

    /

    返回文章
    返回