Iranian Journal of Biomedical Engineering (IJBME)

حذف پس‌زمینه در تصاویر ایکس‌ری آنژیوگرافی با استفاده از بازسازی نواحی مفقود تصاویر توسط یادگیری عمیق

نوع مقاله : مقاله کامل پژوهشی

نویسندگان

1 دانشجوی دکترا، بیوالکتریک، دانشکده‌ی مهندسی پزشکی، دانشگاه صنعتی امیرکبیر، تهران، ایران

2 دانشیار، بیوالکتریک، دانشکده‌ی مهندسی پزشکی، دانشگاه صنعتی امیرکبیر، تهران، ایران

چکیده
در تصویربرداری ایکس‌ری آنژیوگرافی، یکی از چالش‌های اساسی که متخصصان قلب و عروق با آن روبه‌رو هستند، سایه‌های ناخواسته‌ای است که از اعضای ثابت و متحرک داخل قفسه‌ی سینه در دنباله­ی قاب­های تصویری ضبط شده ظاهر می­شود. این سایه‌ها کیفیت تصاویر را کاهش داده و تشخیص گرفتگی رگ­ها را برای متخصصان سخت‌تر می­کنند. برای حل این مشکل، روش­هایی ابداع شده است اما بسیاری از آن‌ها مجبور هستند تمام قاب‌های یک دنباله‌ی ورودی را پردازش کنند و این زمان زیادی می‌طلبد. در عین حال خروجی بسیاری از این روش‌ها هنوز حاوی بخش زیادی از این سایه‌ها است و کیفیت رگ­ها در تصاویر اصلاح شده نیز همیشه راضی کننده نیست. در این تحقیق ابتدا از فیلتر Frangi برای تشخیص عروق کرونری و حذف آن‌ها از قاب تصویری حاوی ماده­ی حاجب استفاده شده است. در ادامه نواحی رگ­ها به شکل یک تصویر ماسک به همراه قاب تصویری حاوی ماده­ی حاجب و هم‌چنین نزدیک‌ترین قاب بدون ماده‌ی حاجب به آن، به ورودی مدل عمیق Deepfillv2-Grayscale داده شده است. این شبکه‌ی پیش‌رفته برای بازسازی بخش‌های حذف شده از تصاویر طراحی شده است. در این تحقیق گونه­ای از این شبکه که روی تصاویر مقیاس خاکستری عمل می­کند به کار گرفته شده و به طور خاص روی تصاویر ایکس‌ری آنژیوگرافی تعلیم تکمیلی داده شده است. در مرحله‌ی آخر تصویر پس‌زمینه‌ی بازسازی شده، از قاب تصویری حاوی ماده­ی حاجب کم شده است تا تصاویر بهتری از عروق با کاهش سایه‌ها به دست آید. رویکرد پیشنهادی می‌تواند به طور موثری زمان پردازش را نسبت به روش‌های سنتی بهبود بخشد. روش پیشنهادی این تحقیق بر اساس معیارهای SSIM و Precision به ترتیب به مقادیر 96/0 و 97/0 دست یافته که در مقایسه با روش‌های پیش‌رفته‌ی شناخته شده مانند FPCP-RPCA، OTS-RPCA، DECOLOR و OSTD برتری دارد.

کلیدواژه‌ها

موضوعات

عنوان مقاله English

Background Subtraction in X-Ray Angiography Images using Image Inpainting via Deep Learning

نویسندگان English

Fateme Akhoondi 1
Farshad Almasganj 2
1 Ph.D. Student, Bioelectric, Biomedical Engineering, Amirkabir University of Technology, Tehran, Iran
2 Associate Professor, Biomedical Engineering, Amirkabir University of Technology, Tehran, Iran
چکیده English

In x-ray angiography imaging, one of the major challenges that cardiovascular specialists face is the unwanted shadows that appear from stationary and moving organs within the chest during a sequence of recorded images. These shadows reduce the quality of the images and make it harder for specialists to diagnose artery blockages. Several methods have been developed to address this issue; however, many of them require processing all frames of an input sequence, which is time-consuming. Moreover, the output of many of these methods still contains a significant amount of shadow, and the quality of the coronary arteries in the corrected images is not always satisfactory. In this study, the Frangi filter is first used to detect the coronary arteries and remove them from the image frame containing the contrast agent. Next, the regions of the arteries are represented as a mask image, along with the frame containing the contrast agent and the closest frame without the contrast agent. These are provided as input to the deep learning model, Deepfillv2-Grayscale. This advanced network is designed to reconstruct the missing parts of the images. In this study, a specific version of this network, which operates on grayscale images, was trained specifically on x-ray angiography images. In the final stage, the reconstructed background image is subtracted from the frame containing the contrast agent, resulting in improved images of the arteries with reduced shadows. The proposed approach can effectively reduce processing time compared to traditional methods. According to SSIM and Precision metrics, the proposed method achieves values of 0.96 and 0.97, respectively, showing superiority over well-known advanced methods such as FPCP-RPCA, OTS-RPCA, DECOLOR, and OSTD.

کلیدواژه‌ها English

X-Ray Angiography
Coronary Arteries
Deep Learning
Contrast Agent
Frangi Filter
Deepfillv2-Grayscale
1.      Z. Gao et al., "Vessel segmentation for X-ray coronary angiography using ensemble methods with deep learning and filter-based features," BMC Medical Imaging, vol. 22, no. 1, p. 10, 2022.
2.      P. Gailloud, S. Oishi, and K. Murphy, "Three-dimensional fusion digital subtraction angiography: new reconstruction algorithm for simultaneous three-dimensional rendering of osseous and vascular information obtained during rotational angiography," American journal of neuroradiology, vol. 26, no. 4, pp. 908-911, 2005.
3.      W. Quan, J. Chen, Y. Liu, D.-M. Yan, and P. Wonka, "Deep learning-based image and video inpainting: A survey," International Journal of Computer Vision, vol. 132, no. 7, pp. 2367-2400, 2024.
4.      A. F. Frangi, W. J. Niessen, K. L. Vincken, and M. A. Viergever, "Multiscale vessel enhancement filtering," in Medical Image Computing and Computer-Assisted Intervention—MICCAI’98: First International Conference Cambridge, MA, USA, October 11–13, 1998 Proceedings 1, 1998: Springer, pp. 130-137.
5.      J. Yu, Z. Lin, J. Yang, X. Shen, X. Lu, and T. S. Huang, "Free-form image inpainting with gated convolution," in Proceedings of the IEEE/CVF international conference on computer vision, 2019, pp. 4471-4480.
6.      K. B. Khan, A. A. Khaliq, A. Jalil, and M. Shahid, "A robust technique based on VLM and Frangi filter for retinal vessel extraction and denoising," PloS one, vol. 13, no. 2, p. e0192203, 2018.
7.      D. Jimenez-Carretero, A. Santos, S. Kerkstra, R. D. Rudyanto, and M. J. Ledesma-Carbayo, "3D Frangi-based lung vessel enhancement filter penalizing airways," in 2013 IEEE 10th international symposium on biomedical imaging, 2013: IEEE, pp. 926-929.
8.      C. Barnes, E. Shechtman, A. Finkelstein, and D. B. Goldman, "PatchMatch: A randomized correspondence algorithm for structural image editing," ACM Trans. Graph., vol. 28, no. 3, p. 24, 2009.
9.      S. Darabi, E. Shechtman, C. Barnes, D. B. Goldman, and P. Sen, "Image melding: Combining inconsistent images using patch-based synthesis," ACM Transactions on graphics (TOG), vol. 31, no. 4, pp. 1-10, 2012.
10.   D. Pathak, P. Krahenbuhl, J. Donahue, T. Darrell, and A. A. Efros, "Context encoders: Feature learning by inpainting," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 2536-2544.
11.   S. Iizuka, E. Simo-Serra, and H. Ishikawa, "Globally and locally consistent image completion," ACM Transactions on Graphics (ToG), vol. 36, no. 4, pp. 1-14, 2017.
12.   G. Liu, F. A. Reda, K. J. Shih, T.-C. Wang, A. Tao, and B. Catanzaro, "Image inpainting for irregular holes using partial convolutions," in Proceedings of the European conference on computer vision (ECCV), 2018, pp. 85-100.
13.   J. Yu, Z. Lin, J. Yang, X. Shen, X. Lu, and T. S. Huang, "Generative image inpainting with contextual attention," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 5505-5514.
14.   I. Gulrajani, F. Ahmed, M. Arjovsky, V. Dumoulin, and A. C. Courville, "Improved training of wasserstein gans," Advances in neural information processing systems, vol. 30, 2017.
15.   J. Adler and S. Lunz, "Banach wasserstein gan," Advances in neural information processing systems, vol. 31, 2018.
16.   Z. Yi, Q. Tang, S. Azizi, D. Jang, and Z. Xu, "Contextual residual aggregation for ultra high-resolution image inpainting," in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 7508-7517.
17.   S. Qu, Z. Niu, J. Zhu, B. Dong, and K. Huang, "Structure first detail next: Image inpainting with pyramid generator," in 2023 IEEE International Conference on Multimedia and Expo (ICME), 2023: IEEE, pp. 1265-1270.
18.   S. Song et al., "Patch-based adaptive background subtraction for vascular enhancement in X-ray cineangiograms," IEEE journal of biomedical and health informatics, vol. 23, no. 6, pp. 2563-2575, 2019.
19.   M. Voorn, U. Exner, and A. Rath, "Multiscale Hessian fracture filtering for the enhancement and segmentation of narrow fractures in 3D image data," Computers & geosciences, vol. 57, pp. 44-53, 2013.
20.   S. Tang, Y. Wang, and Y.-W. Chen, "Application of ICA to X-ray coronary digital subtraction angiography," Neurocomputing, vol. 79, pp. 168-172, 2012.
21.   Y. Bentoutou and N. Taleb, "Automatic extraction of control points for digital subtraction angiography image enhancement," IEEE Transactions on Nuclear Science, vol. 52, no. 1, pp. 238-246, 2005.
22.   M. Nejati, S. Sadri, and R. Amirfattahi, "Nonrigid Image Registration in Digital Subtraction Angiography Using Multilevel B‐Spline," BioMed research international, vol. 2013, no. 1, p. 236315, 2013.
23.   H. Ma, A. Hoogendoorn, E. Regar, W. J. Niessen, and T. van Walsum, "Automatic online layer separation for vessel enhancement in X-ray angiograms for percutaneous coronary interventions," Medical image analysis, vol. 39, pp. 145-161, 2017.
24.   Z. Liu, P. Luo, X. Wang, and X. Tang, "Large-scale celebfaces attributes (celeba) dataset," Retrieved August, vol. 15, no. 2018, p. 11, 2018.
25.   B. Zhou, A. Khosla, A. Lapedriza, A. Torralba, and A. Oliva, "Places: An image database for deep scene understanding," arXiv preprint arXiv:1610.02055, 2016.
26.   H. Zhao, O. Gallo, I. Frosio, and J. Kautz, "Loss functions for image restoration with neural networks," IEEE Transactions on computational imaging, vol. 3, no. 1, pp. 47-57, 2016.
27.   S. Shakeri and F. Almasganj, "Online tree-structure-constrained RPCA for background subtraction of X-ray coronary angiography images," Computer Methods and Programs in Biomedicine, vol. 258, p. 108463, 2025.
28.   H. Ma et al., "Layer separation for vessel enhancement in interventional X-ray angiograms using morphological filtering and robust PCA," in Augmented Environments for Computer-Assisted Interventions: 10th International Workshop, AE-CAI 2015, Held in Conjunction with MICCAI 2015, Munich, Germany, October 9, 2015. Proceedings 10, 2015: Springer, pp. 104-113.
29.   R. Chen, Y. Tong, J. Yang, and M. Wu, "Video foreground detection algorithm based on fast principal component pursuit and motion saliency," Computational intelligence and neuroscience, vol. 2019, no. 1, p. 4769185, 2019.
30.   X. Ye, J. Yang, X. Sun, K. Li, C. Hou, and Y. Wang, "Foreground–background separation from video clips via motion-assisted matrix restoration," IEEE Transactions on Circuits and Systems for Video Technology, vol. 25, no. 11, pp. 1721-1734, 2015.
31.   A. Sobral, S. Javed, S. Ki Jung, T. Bouwmans, and E.-h. Zahzah, "Online stochastic tensor decomposition for background subtraction in multispectral video sequences," in Proceedings of the IEEE International Conference on Computer Vision Workshops, 2015, pp. 106-113.
32.   X. Zhou, C. Yang, and W. Yu, "Moving object detection by detecting contiguous outliers in the low-rank representation," IEEE transactions on pattern analysis and machine intelligence, vol. 35, no. 3, pp. 597-610, 2012.
33.   D. M. Powers, "Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation," arXiv preprint arXiv:2010.16061, 2020.
34.   Z. Wang, E. P. Simoncelli, and A. C. Bovik, "Multiscale structural similarity for image quality assessment," in The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003, 2003, vol. 2: Ieee, pp. 1398-1402.
دوره 18، شماره 1
بهار 1403
صفحه 73-86

  • تاریخ دریافت 01 دی 1403
  • تاریخ بازنگری 05 اسفند 1403
  • تاریخ پذیرش 07 اسفند 1403