نشریه علمی مهندسی پزشکی زیستی

Neural Architecture Search based on UNet using Genetic Algorithm for Extraction of Breast Cancer in Ultrasound Images (GNAS-UNet)

Document Type : Full Research Paper

Authors

1 M.Sc., Biomedical Engineering Department, Hamedan University of Technology, Hamedan, Iran

2 Assistant Professor, Computer Engineering, Hamedan University of Technology, Hamedan, Iran

3 Assistant Professor, Biomedical Engineering Department, Hamedan University of Technology, Hamedan, Iran

Abstract
Accurate segmentation of breast tissue in ultrasound images is crucial for the early detection and analysis of breast cancer. Traditional approaches to medical image segmentation often rely on manually designed neural network architectures, which can be time-consuming and dependent on expert knowledge. In this study, we propose a novel approach that combines Neural Architecture Search (NAS) with a genetic algorithm to optimize the UNet deep neural network for breast tissue segmentation. This combination leverages the strengths of both NAS and evolutionary algorithms to enhance model performance and enable the automated design of efficient architectures. Experimental results demonstrate that our proposed approach is both effective and efficient in optimizing hyperparameters. The automatically constructed UNet models are competitive with manually designed architectures in terms of segmentation accuracy and computational efficiency. The GNAS-UNet model is utilized on the Breast Ultrasound Image Dataset (BUSI). The experimental findings demonstrate competitive performance, achieving an overall DC of 0.937, Miou of 0.906, demonstrating the competitiveness of automated architectures with manually crafted ones. Furthermore, the genetic algorithm's ability to navigate the search space results in the discovery of suitable network configurations that generalize well to new data. Our results underscore the potential of automated machine learning techniques in advancing the accuracy and efficiency of medical image segmentation tasks. One of the primary objectives of this study is to reduce the design time and provide an efficient approach for building optimal architectures.

Keywords

Subjects


  1. Jin, L. Cruz, and N. Gonçalves, “Deep facial diagnosis: deep transfer learning from face recognition to facial diagnosis,” IEEE Access, vol. 8, pp. 123649–123661, 2020.
  2. Yao et al., “Compound figure separation of biomedical images with side loss,” in Deep Generative Models, and Data Augmentation, Labelling, and Imperfections: First Workshop, DGM4MICCAI 2021, and First Workshop, DALI 2021, Held in Conjunction with MICCAI 2021, Strasbourg, France, October 1, 2021, Proceedings 1, 2021, pp. 173–183.
  3. Zhao et al., “VoxelEmbed: 3D instance segmentation and tracking with voxel embedding based deep learning,” in Machine Learning in Medical Imaging: 12th International Workshop, MLMI 2021, Held in Conjunction with MICCAI 2021, Strasbourg, France, September 27, 2021, Proceedings 12, 2021, pp. 437–446.
  4. Minaee, Y. Boykov, F. Porikli, A. Plaza, N. Kehtarnavaz, and D. Terzopoulos, “Image segmentation using deep learning: A survey,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 44, no. 7, pp. 3523–3542, 2021.
  5. Rahman, J. M. J. Valanarasu, I. Hacihaliloglu, and V. M. Patel, “Ambiguous medical image segmentation using diffusion models,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023, pp. 11536–11546.
  6. Kratkiewicz, A. Pattyn, N. Alijabbari, and M. Mehrmohammadi, “Ultrasound and photoacoustic imaging of breast cancer: clinical systems, challenges, and future outlook,” J. Clin. Med., vol. 11, no. 5, p. 1165, 2022.
  7. Suganyadevi, V. Seethalakshmi, and K. Balasamy, “A review on deep learning in medical image analysis,” Int. J. Multimed. Inf. Retr., vol. 11, no. 1, pp. 19–38, 2022.
  8. Sun, B. Xue, M. Zhang, G. G. Yen, and J. Lv, “Automatically designing CNN architectures using the genetic algorithm for image classification,” IEEE Trans. Cybern., vol. 50, no. 9, pp. 3840–3854, 2020.
  9. Rajakumari and L. Kalaivani, “Breast Cancer Detection and Classification Using Deep CNN Techniques.,” Intell. Autom. Soft Comput., vol. 32, no. 2, 2022.
  10. Yadavendra and S. Chand, “A comparative study of breast cancer tumor classification by classical machine learning methods and deep learning method,” Mach. Vis. Appl., vol. 31, no. 6, p. 46, 2020.
  11. Zhang, L. Han, K. Chen, Y. Peng, and J. Lin, “Diagnostic efficiency of the breast ultrasound computer-aided prediction model based on convolutional neural network in breast cancer,” J. Digit. Imaging, vol. 33, pp. 1218–1223, 2020.
  12. M. de Miranda Almeida, D. Chen, A. L. da Silva Filho, and W. C. Brandao, “Machine Learning Algorithms for Breast Cancer Detection in Mammography Images: A Comparative Study.,” in ICEIS (1), 2021, pp. 660–667.
  13. Zoph and Q. V Le, “Neural architecture search with reinforcement learning,” arXiv Prepr. arXiv1611.01578, 2016.
  14. Jaafra, J. L. Laurent, A. Deruyver, and M. S. Naceur, “Reinforcement learning for neural architecture search: A review,” Image Vis. Comput., vol. 89, pp. 57–66, 2019.
  15. Cai, L. Chen, S. Zeng, Y. Lai, and H. Liu, “EST-NAS: An evolutionary strategy with gradient descent for neural architecture search,” Appl. Soft Comput., vol. 146, p. 110624, 2023.
  16. Lv, X. Song, Y. Feng, Y. Ou, Y. Sun, and M. Zhang, “Evolutionary Neural Network Architecture Search,” in Handbook of Evolutionary Machine Learning, Springer, 2023, pp. 247–281.
  17. Ren et al., “Convolutional neural network detection of axillary lymph node metastasis using standard clinical breast MRI,” Clin. Breast Cancer, vol. 20, no. 3, pp. e301–e308, 2020.
  18. Raza, N. Ullah, J. A. Khan, M. Assam, A. Guzzo, and H. Aljuaid, “DeepBreastCancerNet: A novel deep learning model for breast cancer detection using ultrasound images,” Appl. Sci., vol. 13, no. 4, p. 2082, 2023.
  19. Liu, L. Song, S. Liu, and Y. Zhang, “A review of deep-learning-based medical image segmentation methods,” Sustainability, vol. 13, no. 3, p. 1224, 2021.
  20. Chitnis, R. Hosseini, and P. Xie, “Brain tumor classification based on neural architecture search,” Sci. Rep., vol. 12, no. 1, p. 19206, 2022.
  21. Yang et al., “A 3D prediction model for benign or malignant of pulmonary nodules based on neural architecture search,” Signal, Image Video Process., vol. 18, no. 1, pp. 843–852, 2024.
  22. -S. Kang, J. Kang, J.-J. Kim, K.-W. Jeon, H.-J. Chung, and B.-H. Park, “Neural Architecture Search Survey: A Computer Vision Perspective,” Sensors, vol. 23, no. 3. 2023. doi: 10.3390/s23031713.
  23. Wang and W. Zhu, “Advances in neural architecture search,” Natl. Sci. Rev., vol. 11, no. 8, p. nwae282, Aug. 2024, doi: 10.1093/nsr/nwae282.
  24. Črepinšek, S. Liu, and M. Mernik, “Exploration and Exploitation in Evolutionary Algorithms: A Survey,” ACM Comput. Surv., vol. 45, p. Article 35, Jun. 2013, doi: 10.1145/2480741.2480752.
  25. Real et al., “Large-scale evolution of image classifiers,” in International conference on machine learning, 2017, pp. 2902–2911.
  26. Chen, T. Yang, X. Zhang, G. Meng, X. Xiao, and J. Sun, “Detnas: Backbone search for object detection,” Adv. Neural Inf. Process. Syst., vol. 32, 2019.
  27. Li et al., “A generalized framework for population based training,” in Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2019, pp. 1791–1799.
  28. R. Young, D. C. Rose, T. P. Karnowski, S.-H. Lim, and R. M. Patton, “Optimizing deep learning hyper-parameters through an evolutionary algorithm,” in Proceedings of the workshop on machine learning in high-performance computing environments, 2015, pp. 1–5.
  29. U. Nasir, S. Earle, J. Togelius, S. James, and C. Cleghorn, “LLMatic: neural architecture search via large language models and quality diversity optimization,” in Proceedings of the Genetic and Evolutionary Computation Conference, 2024, pp. 1110–1118.
  30. Han, Y. Xue, Z. Wang, Y. Zhang, A. Muravev, and M. Gabbouj, “SaDENAS: A self-adaptive differential evolution algorithm for neural architecture search,” Swarm Evol. Comput., vol. 91, p. 101736, 2024.
  31. Shao, “A Survey on Neural Architecture Search Based on Reinforcement Learning,” arXiv Prepr. arXiv2409.18163, 2024.
  32. S. Carras, C. Pereira, D. Biswas, C. Lee, S. Partridge, and A. M. Alessio, “Genetic algorithm for machine learning architecture selection for breast MRI classification,” in Medical Imaging 2020: Computer-Aided Diagnosis, 2020, vol. 11314, pp. 488–493.
  33. N. Oyelade and A. E. Ezugwu, “A bioinspired neural architecture search based convolutional neural network for breast cancer detection using histopathology images,” Sci. Rep., vol. 11, no. 1, p. 19940, 2021.
  34. Zhang et al., “Fully automatic tumor segmentation of breast ultrasound images with deep learning,” J. Appl. Clin. Med. Phys., vol. 24, Dec. 2022, doi: 10.1002/acm2.13863.
  35. Liu, J. Shi, and Q. Zhang, “Tumor classification by deep polynomial network and multiple kernel learning on small ultrasound image dataset,” Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 9352, pp. 313–320, 2015, doi: 10.1007/978-3-319-24888-2_38.
  36. Liu, S. Xie, J. Yu, L. Niu, and W. Sun, “Classification of thyroid nodules in ultrasound images using deep model based transfer learning and hybrid features,” in 2017 IEEE international conference on acoustics, speech and signal processing (ICASSP), 2017, pp. 919–923.
  37. Han et al., “A deep learning framework for supporting the classification of breast lesions in ultrasound images,” Phys. Med. Biol., vol. 62, no. 19, p. 7714, 2017.
  38. Huang et al., “Unet 3+: A full-scale connected unet for medical image segmentation,” in ICASSP 2020-2020 IEEE international conference on acoustics, speech and signal processing (ICASSP), 2020, pp. 1055–1059.
  39. Weng, T. Zhou, Y. Li, and X. Qiu, “Nas-unet: Neural architecture search for medical image segmentation,” IEEE access, vol. 7, pp. 44247–44257, 2019.
  40. Wu and K. He, “Group normalization,” in Proceedings of the European conference on computer vision (ECCV), 2018, pp. 3–19.
  41. M. Shareef et al., “A Benchmark for Breast Ultrasound Image Classification,” Available SSRN 4339660, 2023.
  42. S. Punn and S. Agarwal, “RCA-IUnet: a residual cross-spatial attention-guided inception U-Net model for tumor segmentation in breast ultrasound imaging,” Mach. Vis. Appl., vol. 33, no. 2, p. 27, 2022.
Volume 18, Issue 1
Spring 2024
Pages 35-49

  • Receive Date 12 June 2024
  • Revise Date 09 December 2024
  • Accept Date 18 January 2025