Journal Article2026

FootSegONN: an ensemble of Self-ONN-based models for diabetic foot ulcer segmentation

Md Shaheenur Islam Sumon, Saadia Binte Alam, Rashedur Rahman, Rusab Sermun, Md Mezbah Ahmed Mahedi, Zaid Bin Mahbub, Rumana Habib, Muhammad EH Chowdhury

Neural Computing and Applications

Springer, Vol. 38, Issue 5, pp. 121, ISBN: 0941-0643

  • Good Health and Well-being — Relevance: 95%

Abstract

Abstract Diabetes mellitus is a chronic metabolic disorder characterized by persistent high blood sugar levels due to insulin deficiencies, leading to complications such as diabetic foot ulcers (DFUs). DFUs are associated with high morbidity and a significant risk of amputation, necessitating precise monitoring and management. Manual measurement of ulcer areas is labor-intensive and error-prone, prompting the need for automated, computer-aided methods. Deep learning (DL) techniques have shown promise in this domain, enhancing the accuracy and efficiency of ulcer detection and segmentation. This study investigates various methodologies for DFU segmentation, focusing on advanced DL models. We propose FootSegONN, an EfficientNet-based encoder and Self-organized Operational Neural Network (Self-ONN) and Feature Pyramid Network-based decoder for foot ulcer segmentation, evaluated on a publicly available chronic wound dataset consisting of 1010 diabetic foot images. Self-ONNs address the limitations of conventional Convolutional neural networks by achieving ultimate heterogeneity and boosting network diversity while maintaining computational efficiency. To ensure robust validation, fivefold cross-validation was applied, and more than 10 different segmentation models were utilized. The STAPLE algorithm is employed to combine mask predictions from top-performing models, and a post-processing approach is investigated to enhance performance further. The proposed method achieved a state-of-the-art Dice score of 91.55%. Furthermore, the combined FootSegONN model achieved a Dice score of 88.97% on the external validation dataset. Gradient-weighted class activation map (Grad-CAM) visualization was utilized to assess the model’s interpretability.

Keywords

  • Diabetic foot ulcer
  • Grad-CAM interpretability

CCDS Authors

Saadia Binte Alam, PhD
Saadia Binte Alam, PhD

Saadia Binte Alam, PhD

  • Director, MIRA & WiSE Wings

Associate Professor

Department of Computer Science and Engineering

Independent University, Bangladesh

Published at

HCII, Scientific Reports, Cognitive Computation, Neural Computing and Applications

Md. Rashedur Rahman, D. Eng.
Md. Rashedur Rahman, D. Eng.

Md. Rashedur Rahman, D. Eng.

  • Co-Director, MIRA & NEST Wings

Assistant Professor

Department of Computer Science and Engineering

Independent University, Bangladesh

Published at

CHI, HCII, Scientific Reports, Cognitive Computation, Neural Computing and Applications

References

  1. 1.Tsung-Yi Lin, Piotr Dollar, Ross Girshick, Kaiming He, Bharath Hariharan, Serge Belongie. (2017). Feature Pyramid Networks for Object Detection. , 936–944[10.1109/cvpr.2017.106]
  2. 2.Ramprasaath R. Selvaraju, Michael Cogswell, Abhishek Das, Ramakrishna Vedantam, Devi Parikh, Dhruv Batra. (2017). Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization. , 618–626[10.1109/iccv.2017.74]
  3. 3.(2013). Diagnosis and Classification of Diabetes Mellitus. Diabetes Care, 37(Supplement_1), S81–S90[10.2337/dc14-s081]
  4. 4.David G. Armstrong, Andrew J.M. Boulton, Sicco A. Bus. (2017). Diabetic Foot Ulcers and Their Recurrence. New England Journal of Medicine, 376(24), 2367–2375[10.1056/nejmra1615439]
  5. 5.S.K. Warfield, K.H. Zou, W.M. Wells. (2004). Simultaneous Truth and Performance Level Estimation (STAPLE): An Algorithm for the Validation of Image Segmentation. IEEE Transactions on Medical Imaging, 23(7), 903–921[10.1109/tmi.2004.828354]
  6. 6.Ziv Yaniv, Bradley C. Lowekamp, Hans J. Johnson, Richard Beare. (2017). SimpleITK Image-Analysis Notebooks: a Collaborative Environment for Education and Reproducible Research. Journal of Imaging Informatics in Medicine, 31(3), 290–303[10.1007/s10278-017-0037-8]
  7. 7.Cihang Xie, Mingxing Tan, Boqing Gong, Jiang Wang, Alan L. Yuille, Quoc V. Le. (2020). Adversarial Examples Improve Image Recognition. , 816–825[10.1109/cvpr42600.2020.00090]
  8. 8.Saba Noor, Mohammad Zubair, Jamal Ahmad. (2015). Diabetic foot ulcer—A review on pathophysiology, classification and microbial etiology. Diabetes & Metabolic Syndrome Clinical Research & Reviews, 9(3), 192–199[10.1016/j.dsx.2015.04.007]
  9. 9.Haikel Alhichri, Asma S. Alswayed, Yakoub Bazi, Nassim Ammour, Naif A. Alajlan. (2021). Classification of Remote Sensing Images Using EfficientNet-B3 CNN Model With Attention. IEEE Access, 9, 14078–14094[10.1109/access.2021.3051085]
  10. 10.Xuan Wang, Chong-Xi Yuan, Bin Xu, Zhi Yu. (2022). Diabetic foot ulcers: Classification, risk factors and management. World Journal of Diabetes, 13(12), 1049–1065[10.4239/wjd.v13.i12.1049]
  11. 11.Chuanbo Wang, D. M. Anisuzzaman, Victor Williamson, Mrinal Kanti Dhar, Behrouz Rostami, Jeffrey Niezgoda, Sandeep Gopalakrishnan, Zeyun Yu. (2020). Fully automatic wound segmentation with deep convolutional neural networks. Scientific Reports, 10(1), 21897[10.1038/s41598-020-78799-w]
  12. 12.Laith Alzubaidi, Mohammed A. Fadhel, Sameer R. Oleiwi, Omran Al-Shamma, Jinglan Zhang. (2019). DFU_QUTNet: diabetic foot ulcer classification using novel deep convolutional neural network. Multimedia Tools and Applications, 79(21-22), 15655–15677[10.1007/s11042-019-07820-w]
  13. 13.Peter Cavanagh, Christopher Attinger, Zulfiqarali Abbas, Arun Bal, Nina Rojas, Zhang‐Rong Xu. (2012). Cost of treating diabetic foot ulcers in five different countries. Diabetes/Metabolism Research and Reviews, 28(S1), 107–111[10.1002/dmrr.2245]
  14. 14.Line Bisgaard Jørgensen, Jens A Sørensen, Gregor BE Jemec, Knud B Yderstræde. (2015). Methods to assess area and volume of wounds – a systematic review. International Wound Journal, 13(4), 540–553[10.1111/iwj.12472]
  15. 15.Alexander M Reyzelman, Kristopher Koelewyn, Maryam Murphy, Xuening Shen, E Yu, Raji Pillai, Jie Fu, Henk Jan Scholten, Ran Ma. (2018). Continuous Temperature-Monitoring Socks for Home Use in Patients With Diabetes: Observational Study. Journal of Medical Internet Research, 20(12), e12460[10.2196/12460]
  16. 16.Kiranyaz, Mustafa Serkan, Ince T., Iosifidis A., Gabbouj M.. (2020). Operational neural networks. Qatar University QSpace (Qatar University)[10.1007/s00521-020-04780-3]
  17. 17.Puneeth N. Thotad, Geeta R. Bharamagoudar, Basavaraj S. Anami. (2022). Diabetic foot ulcer detection using deep learning approaches. Sensors International, 4, 100210[10.1016/j.sintl.2022.100210]
  18. 18.Kiranyaz, Mustafa Serkan, Malik J., Abdallah H.B., Ince T., Iosifidis A., Gabbouj M.. (2021). Self-organized Operational Neural Networks with Generative Neurons. Qatar University QSpace (Qatar University)[10.1016/j.neunet.2021.02.028]
  19. 19.Gaetano Scebba, Jia Zhang, Sabrina Catanzaro, Carina Mihai, Oliver Distler, Martin Berli, Walter Karlen. (2022). Detect-and-segment: A deep learning approach to automate wound image segmentation. Informatics in Medicine Unlocked, 29, 100884[10.1016/j.imu.2022.100884]
  20. 20.Moi Hoon Yap, Bill Cassidy, Joseph M. Pappachan, Claire O'Shea, David Gillespie, Neil D. Reeves. (2021). Analysis Towards Classification of Infection and Ischaemia of Diabetic Foot Ulcers. , 1–4[10.1109/bhi50953.2021.9508563]
  21. 21.Sakib Shahriar Shafin, Gour Karmakar, Iven Mareels. (2023). Obfuscated Memory Malware Detection in Resource-Constrained IoT Devices for Smart City Applications. Sensors, 23(11), 5348[10.3390/s23115348]
  22. 22.Amirreza Mahbod, Gerald Schaefer, Rupert Ecker, Isabella Ellinger. (2022). Automatic Foot Ulcer Segmentation Using an Ensemble of Convolutional Neural Networks. 2022 26th International Conference on Pattern Recognition (ICPR), 4358–4364[10.1109/icpr56361.2022.9956253]
  23. 23.Chuanbo Wang, Amirreza Mahbod, Isabella Ellinger, Adrian Galdran, Sandeep Gopalakrishnan, Jeffrey Niezgoda, Zeyun Yu. (2024). FUSeg: The Foot Ulcer Segmentation Challenge. Information, 15(3), 140[10.3390/info15030140]
  24. 24.Moi Hoon Yap, Bill Cassidy, Michal Byra, Ting-yu Liao, Huahui Yi, Adrian Galdran, Yung-Han Chen, Raphael Brüngel, Sven Koitka, Christoph M. Friedrich, Yu-wen Lo, Ching-hui Yang, Kang Li, Qicheng Lao, Miguel A. González Ballester, Gustavo Carneiro, Yi-Jen Ju, Juinn-Dar Huang, Joseph M. Pappachan, Neil D. Reeves, Vishnu Chandrabalan, Darren Dancey, Connah Kendrick. (2024). Diabetic foot ulcers segmentation challenge report: Benchmark and analysis. Medical Image Analysis, 94, 103153[10.1016/j.media.2024.103153]
  25. 25.Mrinal Kanti Dhar, Taiyu Zhang, Yash Patel, Sandeep Gopalakrishnan, Zeyun Yu. (2024). FUSegNet: A deep convolutional neural network for foot ulcer segmentation. Biomedical Signal Processing and Control, 92, 106057[10.1016/j.bspc.2024.106057]
  26. 26.Bo Song, Ahmet Sacan. (2012). Automated wound identification system based on image segmentation and Artificial Neural Networks. , 1–4[10.1109/bibm.2012.6392633]
  27. 27.N. D. J. Hettiarachchi, R. B. H. Mahindaratne, G. D. C. Mendis, H. T. Nanayakkara, Nuwan D. Nanayakkara. (2013). Mobile based wound measurement. , 298–301[10.1109/pht.2013.6461344]
  28. 28.Malathy Jawahar, L. Jani Anbarasi, S. Graceline Jasmine, Modigari Narendra. (2020). Diabetic Foot Ulcer Segmentation using Color Space Models. , 742–747[10.1109/icces48766.2020.9138024]
  29. 29.Adrian Galdran, Gustavo Carneiro, Miguel A. González Ballester. (2021). Double Encoder-Decoder Networks for Gastrointestinal Polyp Segmentation. Lecture notes in computer science, 293–307[10.1007/978-3-030-68763-2_22]
  30. 30.Md. Sakib Abrar Hossain, Sidra Gul, Muhammad E. H. Chowdhury, Muhammad Salman Khan, Md. Shaheenur Islam Sumon, Enamul Haque Bhuiyan, Amith Khandakar, Maqsud Hossain, Abdus Sadique, Israa Al-Hashimi, Mohamed Arselene Ayari, Sakib Mahmud, Abdulrahman Alqahtani. (2023). Deep Learning Framework for Liver Segmentation from T1-Weighted MRI Images. Sensors, 23(21), 8890[10.3390/s23218890]
  31. 31.Amanda L. Killeen, Kara M. Brock, James F. Dancho, Jodi L. Walters. (2019). Remote Temperature Monitoring in Patients With Visual Impairment Due to Diabetes Mellitus: A Proposed Improvement to Current Standard of Care for Prevention of Diabetic Foot Ulcers. Journal of Diabetes Science and Technology, 14(1), 37–45[10.1177/1932296819848769]
  32. 32.Yang Li, Yu Shen, Huaijun Jiang, Wentao Zhang, Jixiang Li, Ji Liu, Ce Zhang, Bin Cui. (2022). Hyper-tune. Proceedings of the VLDB Endowment, 15(6), 1256–1265[10.14778/3514061.3514071]
  33. 33.Angela Shin-Yu Lien, Chen-Yao Lai, Jyh-Da Wei, Hui-Mei Yang, Jiun-Ting Yeh, Hao-Chih Tai. (2022). A Granulation Tissue Detection Model to Track Chronic Wound Healing in DM Foot Ulcers. Electronics, 11(16), 2617[10.3390/electronics11162617]
  34. 34.David Jozef Hresko, Peter Drotar, Quoc Cuong Ngo, Dinesh Kant Kumar. (2024). Enhanced Domain Adaptation for Foot Ulcer Segmentation Through Mixing Self-Trained Weak Labels. Journal of Imaging Informatics in Medicine, 38(1), 455–466[10.1007/s10278-024-01193-9]