Prognostic Prediction of Gastric Cancer Based on Ensemble Deep Learning of Pathological Images

JIN Huaiping; XUE Feiyue; LI Zhenhui; TAO Haibo; WANG Bin

doi:10.11999/JEIT220655

Volume 45 Issue 7

Jul. 2023

Turn off MathJax

Article Contents

Article Navigation > Journal of Electronics & Information Technology > 2023 > 45(7): 2623-2633

JIN Huaiping, XUE Feiyue, LI Zhenhui, TAO Haibo, WANG Bin. Prognostic Prediction of Gastric Cancer Based on Ensemble Deep Learning of Pathological Images[J]. Journal of Electronics & Information Technology, 2023, 45(7): 2623-2633. doi: 10.11999/JEIT220655

Citation:

JIN Huaiping, XUE Feiyue, LI Zhenhui, TAO Haibo, WANG Bin. Prognostic Prediction of Gastric Cancer Based on Ensemble Deep Learning of Pathological Images[J]. Journal of Electronics & Information Technology, 2023, 45(7): 2623-2633. doi: 10.11999/JEIT220655

Citation:

PDF( 8292 KB)

Prognostic Prediction of Gastric Cancer Based on Ensemble Deep Learning of Pathological Images

doi: 10.11999/JEIT220655

JIN Huaiping^{1, 2
,
,},
XUE Feiyue^{1, 2},
LI Zhenhui³,
TAO Haibo³,
WANG Bin^{1, 2}

1.
Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, China
2.
Yunnan Key Laboratory of Artificial Intelligence, Kunming University of Science and Technology, Kunming 650500, China
3.
Department of Radiology, Yunnan Cancer Hospital, the Third Affiliated Hospital of Kunming Medical University, Kunming 650118, China

Funds: The National Natural Science Foundation of China (82001986), The Joint Special Funds for the Department of Science and Technology of Yunnan Province-Kunming Medical University(202101AY070001-181), The Applied Basic Research Projects of Yunnan Province, China, Outstanding Youth Foundation(202101AW070001)

Received Date: 2022-05-20
Accepted Date: 2022-08-25
Rev Recd Date: 2022-08-22

Available Online: 2022-08-30

Publish Date: 2023-07-10

Abstract

Abstract

The analysis of pathological images is of great significance for the diagnosis and prognosis of gastric cancer. However, its clinical application still faces challenges such as low consistency of visual reading and large differences in multi-resolution images. To address these issues, a prognostic prediction method of gastric cancer based on ensemble deep learning of pathological images is proposed. First, the pathological images at different resolutions of patient are preprocessed by slicing and filtering. Then, the deep feature extraction and fusion of slices at different resolutions are carried out by using three deep learning methods, i.e., ResNet, MobileNetV3, and EfficientNetV2, respectively, which aims to obtain the single-resolution prediction results of individual classifier at patient level. Finally, a double-level ensemble strategy is used to fuse the prediction results of heterogeneous individual classifiers at different resolutions to obtain the patient-level prognostic prediction results. In the experiment, the pathological images of 250 gastric cancer patients are collected, and the prediction of distant metastases is used as an example for verification. The experimental results show that the prediction accuracy of the proposed method on the test set is 89.10%, the sensitivity is 89.57%, the specificity is 88.61%, and the Matthews correlation coefficient is 78.19%. Compared with the single-model prediction results, the prediction performance of the proposed method has been significantly improved, which can provide an important reference for the treatment and prognosis of gastric cancer patients.
- Pathological image,
- Ensemble learning,
- Deep learning,
- Gastric cancer,
- Prognosis prediction

FullText(HTML)

References(21)

References

[1]	SUNG H, FERLAY J, SIEGEL R L, et al. Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries[J]. CA:A Cancer Journal for Clinicians, 2021, 71(3): 209–249. doi: 10.3322/caac.21660
[2]	DAGOGO-JACK I and SHAW A T. Tumour heterogeneity and resistance to cancer therapies[J]. Nature Reviews Clinical Oncology, 2018, 15(2): 81–94. doi: 10.1038/nrclinonc.2017.166
[3]	TAKTAK A F G and FISHER A C. Outcome Prediction in Cancer[M]. Amsterdam: Elsevier, 2006: 16-17.
[4]	GORLIA T, VAN DEN BENT M J, HEGI M E, et al. Nomograms for predicting survival of patients with newly diagnosed glioblastoma: Prognostic factor analysis of EORTC and NCIC trial 26981-22981/CE. 3[J]. The Lancet Oncology, 2008, 9(1): 29–38. doi: 10.1016/S1470-2045(07)70384-4
[5]	YU Chaoran and ZHANG Yujie. Development and validation of prognostic nomogram for young patients with gastric cancer[J]. Annals of Translational Medicine, 2019, 7(22): 641. doi: 10.21037/atm.2019.10.77
[6]	ZHANG Yanbo and YU Hengyong. Convolutional neural network based metal artifact reduction in X-ray computed tomography[J]. IEEE Transactions on Medical Imaging, 2018, 37(6): 1370–1381. doi: 10.1109/TMI.2018.2823083
[7]	HAMEED A A, KARLIK B, and SALMAN M S. Back-propagation algorithm with variable adaptive momentum[J]. Knowledge-Based Systems, 2016, 114: 79–87. doi: 10.1016/j.knosys.2016.10.001
[8]	徐莹莹, 沈红斌. 基于模式识别的生物医学图像处理研究现状[J]. 电子与信息学报, 2020, 42(1): 201–213. doi: 10.11999/JEIT190657 XU Yingying and SHEN Hongbin. Review of research on biomedical image processing based on pattern recognition[J]. Journal of Electronics &Information Technology, 2020, 42(1): 201–213. doi: 10.11999/JEIT190657
[9]	GREENSPAN H, VAN GINNEKEN B, and SUMMERS R M. Guest editorial deep learning in medical imaging: Overview and future promise of an exciting new technique[J]. IEEE Transactions on Medical Imaging, 2016, 35(5): 1153–1159. doi: 10.1109/TMI.2016.2553401
[10]	LUO J, WU Min, GOPUKUMAR D, et al. Big data application in biomedical research and health care: A literature review[J]. Biomedical Informatics Insights, 2016, 8: 1–10. doi: 10.4137/BII.S31559
[11]	ESTEVA A, KUPREL B, NOVOA R A, et al. Dermatologist-level classification of skin cancer with deep neural networks[J]. Nature, 2017, 542(7639): 115–118. doi: 10.1038/nature21056
[12]	JIANG Yuming, JIN Cheng, YU Heng, et al. Development and validation of a deep learning CT signature to predict survival and chemotherapy benefit in gastric cancer: A multicenter, retrospective study[J]. Annals of Surgery, 2021, 274(6): e1153–e1161. doi: 10.1097/SLA.0000000000003778
[13]	陈雯, 王旭, 段辉宏, 等. 深度学习在癌症预后预测模型中的应用研究[J]. 生物医学工程学杂志, 2020, 37(5): 918–929. doi: 10.7507/1001-5515.201909066 CHEN Wen, WANG Xu, DUAN Huihong, et al. Application of deep learning in cancer prognosis prediction model[J]. Journal of Biomedical Engineering, 2020, 37(5): 918–929. doi: 10.7507/1001-5515.201909066
[14]	KATHER J N, PEARSON A T, HALAMA N, et al. Deep learning can predict microsatellite instability directly from histology in gastrointestinal cancer[J]. Nature Medicine, 2019, 25(7): 1054–1056. doi: 10.1038/s41591-019-0462-y
[15]	SKREDE O J, DE RAEDT S, KLEPPE A, et al. Deep learning for prediction of colorectal cancer outcome: A discovery and validation study[J]. The Lancet, 2020, 395(10221): 350–360. doi: 10.1038/s41591-019-0462-y
[16]	杨昆, 常世龙, 王尉丞, 等. 基于sECANet通道注意力机制的肾透明细胞癌病理图像ISUP分级预测[J]. 电子与信息学报, 2022, 44(1): 138–148. doi: 10.11999/JEIT210900 YANG Kun, CHANG Shilong, WANG Yucheng, et al. Predict the ISUP grade of clear cell renal cell carcinoma using pathological images based on sECANet Chanel attention[J]. Journal of Electronics &Information Technology, 2022, 44(1): 138–148. doi: 10.11999/JEIT210900
[17]	HE Kaiming, ZHANG Xianyu, REN Shaoqing, et al. Deep residual learning for image recognition[C]. 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, USA, 2016: 770–778.
[18]	HOWARD A, SANDLER M, CHEN Bo, et al. Searching for MobileNetV3[C]. 2019 IEEE/CVF International Conference on Computer Vision, Seoul, Korea (South), 2019: 1314–1324.
[19]	TAN Mingxing and LE Q. EfficientNetV2: Smaller models and faster training[C/OL]. The 38th International Conference on Machine Learning, 2021: 10096–10106.
[20]	于凌涛, 夏永强, 闫昱晟, 等. 利用卷积神经网络分类乳腺癌病理图像[J]. 哈尔滨工程大学学报, 2021, 42(4): 567–573. doi: 10.11990/jheu.201909052 YU Lingtao, XIA Yongqiang, YAN Yusheng, et al. Breast cancer pathological image classification based on a convolutional neural network[J]. Journal of Harbin Engineering University, 2021, 42(4): 567–573. doi: 10.11990/jheu.201909052
[21]	SELVARAJU R R, COGSWELL M, DAS A, et al. Grad-CAM: Visual explanations from deep networks via gradient-based localization[J]. International Journal of Computer Vision, 2020, 128(2): 336–359. doi: 10.1007/s11263-019-01228-7