Advanced Search
Turn off MathJax
Article Contents
GAO Peng, ZHANG Ruonan, LIU Libo. Text Semantic-Guided Dynamic Curriculum Learning for Class-Incremental Object Detection[J]. Journal of Electronics & Information Technology. doi: 10.11999/JEIT260987
Citation: GAO Peng, ZHANG Ruonan, LIU Libo. Text Semantic-Guided Dynamic Curriculum Learning for Class-Incremental Object Detection[J]. Journal of Electronics & Information Technology. doi: 10.11999/JEIT260987

Text Semantic-Guided Dynamic Curriculum Learning for Class-Incremental Object Detection

doi: 10.11999/JEIT260987 cstr: 32379.14.JEIT260987
Funds:  Natural Science Foundation of Ningxia, China (No. 2024AAC02010), Science and Technology Leading Talent Training Projects of Ningxia (No. 2022GKLRLX03), National Natural Science Foundation of China (No. 62262053, No. 62506179), Yinchuan City Science and Technology Projects (No. 2025RC09), Postgraduate Innovation Project of Ningxia University (CXXM2026127)
  • Accepted Date: 2026-11-17
  • Rev Recd Date: 2026-11-17
  • Available Online: 2026-11-21
  •   Objective  Class-incremental object detection requires a detector to learn new categories while retaining its ability to recognize previously learned ones, typically without access to historical training data. Existing approaches mainly rely on knowledge distillation and pseudo-label replay, but still face three limitations: visual classification heads lack stable semantic priors, confidence-based replay may retain semantically incorrect teacher predictions, and fixed distillation schedules cannot adapt to the learning progress of new classes. These limitations lead to category confusion, noisy supervision, and conflicts between new-class learning and old-class preservation. To address these issues, we develop TD-DETR, a text semantic-guided dynamic curriculum learning framework for class-incremental object detection.  Methods  TD-DETR builds on Deformable DETR and extends the CC-DETR baseline with three complementary components. First, the semantic prior-based discrimination module (SPDM) encodes multiple prompts for each category using a frozen CLIP text encoder and averages their representations to obtain category-level text prototypes. Detection queries are projected into the CLIP semantic space and classified according to their similarity to these prototypes. This provides stable semantic constraints for distinguishing old and new categories. Second, the vision-text assisted pseudo-label filtering module (VTPF) refines old-class predictions generated by the teacher detector. For each candidate box, its image region and predicted category are used to construct a visual question. A frozen vision-language model then determines whether the region is semantically consistent with the predicted old category. Only consistent candidates are retained, after which IOU-based conflict suppression removes boxes that overlap with current ground-truth annotations. Third, the dynamic adaptive curriculum distillation strategy (DACD) adjusts old-class distillation according to the new-class classification loss. The detector initially focuses on learning current categories. Distillation is activated when the loss falls to a predefined level or a maximum waiting epoch is reached, and its weight is subsequently increased in a linear manner. This curriculum enables a gradual transition from new-class acquisition to the joint optimization of new- and old-class knowledge.  Results and Discussions  We evaluate TD-DETR on the coarse-grained MS COCO 2017 dataset and the fine-grained HiFSOD-Bird dataset. MS COCO 2017 uses the single-stage splits 70+10 and 40+40 and the multi-stage splits 40+20+20 and 40+10+10+10+10. HiFSOD-Bird contains 176,350 images from 1,432 bird categories and is evaluated under the single-stage splits 1074+358 and 716+716 and the multi-stage splits 716+358+358 and 716+179+179+179+179. On MS COCO 2017, TD-DETR achieves AP scores of 42.7% and 41.2% under the 70+10 and 40+40 settings, outperforming the CC-DETR baseline by 1.8 and 2.1 percentage points, respectively. On HiFSOD-Bird, it obtains 46.5% and 47.2% AP under the 1074+358 and 716+716 settings, improving upon CC-DETR by 2.4 and 2.2 percentage points. TD-DETR also maintains higher accuracy and a slower performance decline throughout the multi-stage experiments. Ablation studies confirm the complementary effects of the three components. On the MS COCO 2017 70+10 split, SPDM, VTPF, and DACD progressively increase AP from 40.9% to 41.4%, 42.1%, and 42.7%. On the HiFSOD-Bird 1074+358 split, AP increases from 44.1% to 44.9%, 46.0%, and 46.5%, respectively. These results show that semantic priors improve category discrimination, vision-language verification enhances pseudo-label reliability, and curriculum distillation better balances new-class learning and old-class preservation.  Conclusions  We present TD-DETR to address category confusion, unreliable old-class pseudo labels, and conflicting training objectives in class-incremental object detection. By combining semantic prior-based discrimination, vision-text assisted pseudo-label filtering, and adaptive curriculum distillation, TD-DETR improves both new-class learning and old-class knowledge retention. Experiments on MS COCO 2017 and HiFSOD-Bird demonstrate consistent gains across coarse-grained, fine-grained, single-stage, and multi-stage settings, indicating that text semantics provide effective guidance for alleviating catastrophic forgetting and improving incremental detection stability.
  • loading
  • [1]
    梁燕, 杨会林, 邵凯. 自适应特征选择的车路协同3D目标检测方案[J]. 电子与信息学报, 2025, 47(12): 5214–5225. doi: 10.11999/JEIT250601.

    LIANG Yan, YANG Huilin, and SHAO Kai. A vehicle-infrastructure cooperative 3D object detection scheme based on adaptive feature selection[J]. Journal of Electronics & Information Technology, 2025, 47(12): 5214–5225. doi: 10.11999/JEIT250601.
    [2]
    吕晓华, 魏铭辰, 刘立波. 基于位置可学习视觉中心机制的零售商品检测方法[J]. 物联网学报, 2023, 7(4): 142–152. doi: 10.11959/j.issn.2096-3750.2023.00366.

    LYU Xiaohua, WEI Mingchen, and LIU Libo. Retail commodity detection method based on location learnable visual center mechanism[J]. Chinese Journal on Internet of Things, 2023, 7(4): 142–152. doi: 10.11959/j.issn.2096-3750.2023.00366.
    [3]
    翁星星, 庞超, 许博文, 等. 面向遥感图像解译的增量深度学习[J]. 电子与信息学报, 2024, 46(10): 3979–4001. doi: 10.11999/JEIT240172.

    WENG Xingxing, PANG Chao, XU Bowen, et al. Incremental deep learning for remote sensing image interpretation[J]. Journal of Electronics & Information Technology, 2024, 46(10): 3979–4001. doi: 10.11999/JEIT240172.
    [4]
    李斌, 崔宗勇, 汪浩瀚, 等. SAR目标增量识别中基于最大化非重合体积的样例挑选方法[J]. 电子与信息学报, 2024, 46(10): 3918–3927. doi: 10.11999/JEIT240217.

    LI Bin, CUI Zongyong, WANG Haohan, et al. Exemplar selection based on maximizing non-overlapping volume in SAR target incremental recognition[J]. Journal of Electronics & Information Technology, 2024, 46(10): 3918–3927. doi: 10.11999/JEIT240217.
    [5]
    张东阳, 陆子轩, 刘军民, 等. 深度模型的持续学习综述: 理论、方法和应用[J]. 电子与信息学报, 2024, 46(10): 3849–3878. doi: 10.11999/JEIT240095.

    ZHANG Dongyang, LU Zixuan, LIU Junmin, et al. A survey of continual learning with deep networks: Theory, method and application[J]. Journal of Electronics & Information Technology, 2024, 46(10): 3849–3878. doi: 10.11999/JEIT240095.
    [6]
    SHMELKOV K, SCHMID C, and ALAHARI K. Incremental learning of object detectors without catastrophic forgetting[C]. Proceedings of 2017 IEEE International Conference on Computer Vision, Venice, Italy, 2017: 3420–3429. doi: 10.1109/ICCV.2017.368.
    [7]
    PENG Can, ZHAO Kun, and LOVELL B C. Faster ILOD: Incremental learning for object detectors based on faster RCNN[J]. Pattern Recognition Letters, 2020, 140: 109–115. doi: 10.1016/j.patrec.2020.09.030.
    [8]
    FENG Tao, WANG Mang, and YUAN Hangjie. Overcoming catastrophic forgetting in incremental object detection via elastic response distillation[C]. Proceedings of 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, USA, 2022: 9427–9436. doi: 10.1109/CVPR52688.2022.00921.
    [9]
    PENG Can, ZHAO Kun, MAKSOUD S, et al. DIODE: Dilatable incremental object detection[J]. Pattern Recognition, 2023, 136: 109244. doi: 10.1016/j.patcog.2022.109244.
    [10]
    ZHU Xizhou, SU Weijie, LU Lewei, et al. Deformable DETR: Deformable transformers for end-to-end object detection[C]. Proceedings of the 9th International Conference on Learning Representations, 2021. (查阅网上资料, 未找到对应的出版地信息, 请确认).
    [11]
    LIU Yaoyao, SCHIELE B, VEDALDI A, et al. Continual detection transformer for incremental object detection[C]. Proceedings of 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, Canada, 2023: 23799–23808. doi: 10.1109/CVPR52729.2023.02279.
    [12]
    ZHANG Jichuan, LI Wei, CHENG Shuang, et al. Dynamic object queries for transformer-based incremental object detection[C]. Proceedings of 2025 IEEE International Conference on Acoustics, Speech and Signal Processing, Hyderabad, India, 2025: 1–5. doi: 10.1109/ICASSP49660.2025.10888317.
    [13]
    RADFORD A, KIM J W, HALLACY C, et al. Learning transferable visual models from natural language supervision[C]. Proceedings of the 38th International Conference on Machine Learning, 2021: 8748–8763. (查阅网上资料, 未找到对应的出版地信息, 请确认).
    [14]
    LI Dawei, TASCI S, GHOSH S, et al. RILOD: Near real-time incremental learning for object detection at the edge[C]. Proceedings of the 4th ACM/IEEE Symposium on Edge Computing, Arlington, USA, 2019: 113–126. doi: 10.1145/3318216.3363317.
    [15]
    PENG Can, ZHAO Kun, MAKSOUD S, et al. SID: Incremental learning for anchor-free object detection via selective and inter-related distillation[J]. Computer Vision and Image Understanding, 2021, 210: 103229. doi: 10.1016/j.cviu.2021.103229.
    [16]
    BENGIO Y, LOURADOUR J, COLLOBERT R, et al. Curriculum learning[C]. Proceedings of the 26th Annual International Conference on Machine Learning, Montreal, Canada, 2009: 41–48. doi: 10.1145/1553374.1553380.
    [17]
    ZHAO Yian, LV Wenyu, XU Shangliang, et al. DETRs beat YOLOs on real-time object detection[C]. Proceedings of 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, USA, 2024: 16965–16974. doi: 10.1109/CVPR52733.2024.01605.
    [18]
    高鹏, 张若楠, 刘立波. CC-DETR: 基于课程式学习蒸馏的类增量目标检测方法[J]. 物联网学报, 2026. doi: 10.11959/j.issn.2096-3750.WLW25193.

    GAO Peng, ZHANG Ruonan, and LIU Libo. CC-DETR: Class incremental object detection algorithm based on curriculum learning distillation[J]. Chinese Journal on Internet of Things, 2026. doi: 10.11959/j.issn.2096-3750.WLW25193.
    [19]
    LIU Shilong, ZENG Zhaoyang, REN Tianhe, et al. Grounding DINO: Marrying DINO with grounded pre-training for open-set object detection[C]. Proceedings of the 18th European Conference on Computer Vision, Milan, Italy, 2025. doi: 10.1007/978-3-031-72970-6_3.
    [20]
    才华, 冉越, 付强, 等. 多粒度文本感知分层特征交互的视觉定位方法[J]. 电子与信息学报, 2025, 47(11): 4594–4605. doi: 10.11999/JEIT250387.

    CAI Hua, RAN Yue, FU Qiang, et al. Multi-granularity text perception and hierarchical feature interaction method for visual grounding[J]. Journal of Electronics & Information Technology, 2025, 47(11): 4594–4605. doi: 10.11999/JEIT250387.
    [21]
    PENG Yansong, LI Hebei, WU Peixi, et al. D-FINE: Redefine regression task in DETRs as fine-grained distribution refinement[C]. Proceedings of the International Conference on Learning Representations, Singapore, Singapore, 2025. (查阅网上资料, 无法确认出版地信息是否正确).
    [22]
    MO Qijie, GAO Yipeng, FU Shenghao, et al. Bridge past and future: Overcoming information asymmetry in incremental object detection[C]. Proceedings of the 18th European Conference on Computer Vision, Milan, Italy, 2025: 463–480. doi: 10.1007/978-3-031-72640-8_26.
    [23]
    MASANA M, LIU Xialei, TWARDOWSKI B, et al. Class-incremental learning: Survey and performance evaluation on image classification[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023, 45(5): 5513–5533. doi: 10.1109/TPAMI.2022.3213473.
    [24]
    LIN T Y, MAIRE M, BELONGIE S, et al. Microsoft COCO: Common objects in context[C]. Proceedings of the 13th European Conference on Computer Vision, Zurich, Switzerland, 2014: 740–755. doi: 10.1007/978-3-319-10602-1_48.
    [25]
    ZHANG Lu, WANG Yang, ZHOU Jiaogen, et al. Hierarchical few-shot object detection: Problem, benchmark and method[C]. Proceedings of the 30th ACM International Conference on Multimedia, Lisbon, Portugal, 2022: 2002–2011. doi: 10.1145/3503161.3548412.
    [26]
    AN Zijia, DIAO Boyu, HUANG Libo, et al. IOR: Inversed objects replay for incremental object detection[C]. Proceedings of 2025 IEEE International Conference on Acoustics, Speech and Signal Processing, Hyderabad, India, 2025: 1–5. doi: 10.1109/ICASSP49660.2025.10888892.
    [27]
    MA Mingxiao, ZHU Shunyao, and KANG Guoliang. Index-aligned query distillation for transformer-based incremental object detection[EB/OL]. https://arxiv.org/abs/2508.11339, 2025.
    [28]
    ZHANG Shizhou, LV Xueqiang, XING Yinghui, et al. Revisiting generative replay for class incremental object detection[C]. Proceedings of 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, USA, 2025: 20340–20349. doi: 10.1109/CVPR52734.2025.01894.
    [29]
    WANG Jianzhou, WU Yirui, YUAN Lixin, et al. Diffuse&Refine: Intrinsic knowledge generation and aggregation for incremental object detection[C]. Proceedings of the 34th International Joint Conference on Artificial Intelligence, Jeju, South Korea, 2025: 700. doi: 10.24963/ijcai.2025/700.
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Figures(6)  / Tables(10)

    Article Metrics

    Article views (11) PDF downloads(1) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return