Improving the accuracy of the PET/MRI tridimensional multimodal rigid image registration based on the FATEMD

Abderazzak Taime, Aziz Khamjane, Jamal Riffi, Hamid Tairi

Abstract


The subject matter of the article is the improvement in the accuracy of multimodal image registration between PET and MRI images in the medical field. The focus of the article pertains to the importance of these images in diagnosis, interpretation, and surgical intervention. This study increased the accuracy of PET/MRI multimodal image registration achieved through a new approach based on the multi-resolution image decomposition. The tasks to be solved are: The study proposes a new method, the fast and adaptive three-dimensional mode decomposition (FATEMD), to generate multi-resolution components for accurate registration. The method used: The study uses the FATEMD approach, which estimates the transformation parameters of the registration from the PET image and the residue of the second level of the MRI image that is obtained after the extraction of the first two tridimensional intrinsic mode functions (TIMFs). The following results were obtained: The proposed method of multimodal registration between PET and MRI images involves the use of the fast and adaptive three-dimensional mode decomposition (FATEMD) approach. This approach was tested on 25 pairs of images from the Vanderbilt database and was found to have improved accuracy compared to the usual method, as shown through comparative studies using measures of mutual information, normalized mutual information, and entropy correlation coefficient. Conclusion. The main objective achieved in the study was to enhance the accuracy of PET/MRI multimodal image registration through the application of the FATEMD decomposition method. This approach is novel compared to traditional methods as it involves estimating the transformation parameters from the PET image and the second level residue of the MRI image, resulting in more precise outcomes as opposed to using just the PET and MRI images alone. The integration of multiple imaging techniques, such as PET and MRI, provides healthcare professionals with a more comprehensive view of a patient's anatomy and physiology, leading to enhanced diagnosis and treatment planning.

Keywords


Rigid Registration; Multimodal Registration; FATEMD; TIMF; Mutual Information; anatomical information; PET; MRI

Full Text:

PDF

References


Maryushko, M. V., Pashchenko, R. E. Fraktalʹnyy analiz kosmichnykh znimkiv Sentinel-2 dlya monitorynhu silʹsʹkohospodarsʹkykh kulʹtur [Fractal analysis of Sentinel-2 satellite imagery for monitoring of agricultural crops]. Radioelectronic and Computer Systems, 2020, no. 4, pp. 34-47. DOI: 10.32620/reks.2020.4.03.

Wu, F. et al. Rachis detection and three-dimensional localization of cut off point for vision-based banana robot. Computers and Electronics in Agriculture, 2022, vol. 198, article no. 107079. DOI: 10.1016/j.compag.2022.107079.

Zhao, Z. et al. Augmented Reality Calibration with Stereo Image Registration for Surgical Navigation. International Conference on Image Processing, Computer Vision and Machine Learning (ICICML), Xi’an, China, 2022, pp. 24-30. DOI: 10.1109/ICICML57342.2022.10009830.

Cong, B. et al. Multi exposure image motion estimation based on improved optical flow. AOPC 2022: Optical Sensing, Imaging, and Display Technology, 2023, vol. 12557, pp. 135-139. DOI: 10.1117/12.2648115.

Zhou, T. et al. Hi-net: hybrid-fusion network for multi-modal MR image synthesis. EEE Transactions on Medical Imaging, 2020, vol. 39, no. 9, pp. 2772-2781. DOI: 10.1109/TMI.2020.2975344.

Proskura, G., Rubel, O., Lukin, V. On classifier learning methodologies with application to compressed remote sensing images. Radioelectronic and Computer Systems, 2022, no. 3, pp. 174-189. DOI: 10.32620/reks.2022.3.13.

Patel, M. J., Kothari, A. M., Koringa, H. P. A novel approach for semantic segmentation of automatic road network extractions from remote sensing images by modified UNet. Radioelectronic and Computer Systems, 2022, no. 3, pp. 161-173. DOI: 10.32620/reks.2022.3.12

Fu, Y. et al. Deep learning in medical image registration: a review. Physics in Medicine & Biology, 2020, vol. 65, no. 20, article no. 20TR01. DOI: 10.1088/1361-6560/ab843e.

Rong, Y. et al. Rigid and deformable image registration for radiation therapy: A self-study evaluation guide for NRG Oncology Clinical Trial Participation. Practical radiation oncology, 2021, vol. 11, no. 4, pp. 282-298. DOI: 10.1016/j.prro.2021.02.007.

Nair, R. R., Singh, T. Optimal wavelet-based multi-modal medical image fusion with quantitative analysis for colour images using different colour models. International Journal of Biomedical Engineering and Technology, 2022, vol. 40, no. 3, pp. 262-288. DOI : 10.1504/IJBET.2022.126496.

Gai, D. et al. Medical image fusion via PCNN based on edge preservation and improved sparse representation in NSST domain. IEEE Access, 2019, vol. 7, pp. 85413-85429. DOI: 10.1109/ACCESS.2019.2925424.

Ren, J. et al. Comparing different CT, PET and MRI multi-modality image combinations for deep learning-based head and neck tumor segmentation. Acta Oncologica, 2021, vol. 60, no. 11, pp. 1399-1406. DOI: 10.1080/0284186X.2021.1949034.

Huang, N. E. et al. The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis. Proceedings of the Royal Society of London. Series A: mathematical, physical and engineering sciences, 1998, vol. 454, no. 1971, pp. 903-995. DOI: 10.1098/rspa.1998.0193.

Nunes, J. C., Guyot, S., Deléchelle, E. Texture analysis based on local analysis of the bidimensional empirical mode decomposition. Machine Vision and Applications, 2005, vol. 16, pp. 177-188. DOI: 10.1007/s00138-004-0170-5.

Nunes, J. C. et al. Image analysis by bidimensional empirical mode decomposition. Image and vision computing, 2003, vol. 21, no. 12, pp. 1019-1026. DOI: 10.1016/S0262-8856(03)00094-5.

Yousefi Rizi, F. A review of notable studies on using Empirical Mode Decomposition for biomedical signal and image processing. Signal Processing and Renewable Energy, 2019, vol. 3, article no. 4, pp. 89-113. Available at: https://journals.iau.ir/article_669673_0557144fe9dffffb5fa45c996dcf420a.pdf. (accessed 10 November 2022).

Zhu, P., Liu, L. and Zhou, X. Infrared polarization and intensity image fusion based on bivariate BEMD and sparse representation. Multimedia Tools and Applications, 2021, vol. 80, pp. 4455-4471. DOI : 10.1007/s11042-020-09860-z

Madhavi, V., Bobby, T. C. Thermal imaging based breast cancer analysis using BEMD and uniform RLBP. Third International Conference on Biosignals, Images and Instrumentation (ICBSII), Chennai, India, 2017, pp. 1-6. DOI: 10.1109/ICBSII.2017.8082268.

Bui, T.-A. et al. Using BEMD in CNN to identify landslide in satellite image. International Conference on System Science and Engineering (ICSSE), Dong Hoi, Vietnam, 2019, pp. 94-97. DOI: 10.1109/ICSSE.2019.8823128.

Bhuiyan, S. M. A., Adhami, R. R., Khan, J. F. Fast and Adaptive Bidimensional Empirical Mode Decomposition Using Order-Statistics Filter Based Envelope Estimation. EURASIP Journal on Advances in Signal Processing, 2008, article no. 728356. DOI: 10.1155/2008/728356.

An, Y. et al. Infrared and Visible Image Fusion Based on Adaptive Dual-Channel PCNN and Saliency Detection. 15th International Conference on Computational Intelligence and Security, 2019, pp. 20-25. DOI: 10.1109/CIS.2019.00013.

Riffi, J., Mohamed Mahraz, A., Tairi, H. Medical image registration based on fast and adaptive bidimensional empirical mode decomposition. IET Image Processing, 2013, vol. 7, no. 6, pp. 567-574. DOI: 10.1049/iet-ipr.2012.0034.

Guryanov, F., Krylov, A. Fast medical image registration using bidirectional empirical mode decomposition. Signal Processing: Image Communication, 2017, vol. 59, pp. 12-17. DOI: 10.1016/j.image.2017.04.003.

Adoui El Ouadrhiri, A., Jai-Andaloussi, S., Ouchetto, O. Video block and FABEMD features for an effective and fast method of reporting near-duplicate and mirroring videos. Journal of Big Data, 2021, vol. 8, article no. 138. DOI: 10.1186/s40537-021-00526-7.

Batziou, E. et al. Artistic neural style transfer using CycleGAN and FABEMD by adaptive information selection. Pattern Recognition Letters, 2023, vol. 165, pp. 55-62. DOI: 10.1016/j.patrec.2022.11.026.

Riffi, J. et al. 3D extension of the fast and adaptive bidimensional empirical mode decomposition. Multidimensional Systems and Signal Processing, 2015, vol. 26, pp. 823-834. DOI: 10.1007/s11045-014-0283-6.

Boveiri, H. et al. Medical image registration using deep neural networks: a comprehensive review. Computers & Electrical Engineering, 2020, vol. 87, article no. 106767. DOI: 10.1016/j.compeleceng.2020.106767.

Zhang, H. et al. Registration of multimodal remote sensing image based on deep fully convolutional neural network. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2019, vol 12, no. 8, pp. 3028-3042. DOI: 10.1109/JSTARS.2019.2916560.

Gao, Z., Gu, B., Lin, J. Monomodal image registration using mutual information based methods. Image and Vision Computing, 2008, vol. 26, no. 2, pp. 164-173. DOI: 10.1016/j.imavis.2006.08.002.

Pluim, J. P. W., Maintz, J. B. A., Viergever, M. A. Mutual information matching in multiresolution contexts. Image and Vision Computing, 2001, vol. 19, no. 1-2, pp. 45-52. DOI: 10.1016/S0262-8856(00)00054-8.

Maes, F. et al. Multimodality image registration by maximization of mutual information. IEEE transactions on Medical Imaging, 1997, vol. 16, no. 2, pp. 187-198. DOI: 10.1109/42.563664.

Sotiras, A. et al. Simultaneous Geometric – Iconic Registration. 13th International Conference on Medical Image Computing and Computer Assisted Intervention - MICCAI 2010, Beijing, China, 2010, pp. 676-683. DOI: 10.1007/978-3-642-15745-5_83.

Viola, P., Wells, W. M. Alignment by maximization of mutual information. Proceedings of IEEE International Conference on Computer Vision, Cambridge, MA, USA, 1995, pp. 16-23. DOI: 10.1109/ICCV.1995.466930.

Collignon, A. et al. Automated multi-modality image registration based on information theory. Information processing in medical imaging, 1995, vol. 3, article no. 6, pp. 263-274.

Viergever, M. A. et al. A survey of medical image registration – under review. Medical image analysis, 2016, vol. 33, pp. 140-144. DOI: 10.1016/j.media.2016.06.030.

Yang, F., Fu, K. Medical images registration based on gradient mutual information and improved genetic algorithm. International Conference on Communication Systems and Network Technologies, Rajkot, Gujarat, India, 2012, pp. 250-253. DOI: 10.1109/CSNT.2012.62.

Carrillo, A. et al. Semiautomatic 3-D image registration as applied to interventional MRI liver cancer treatment. IEEE Transactions on Medical Imaging, 2000, vol. 19, no. 3, pp. 175-185. DOI: 10.1109/42.845176.

Torlapati, J., Clement, T. P. Using parallel genetic algorithms for estimating model parameters in complex reactive transport problems. Processes, 2019, vol. 7, iss. 10, article no. 640. DOI: 10.3390/pr7100640.

Cosma, O., Pop, P. C., Dănciulescu, D. A parallel algorithm for solving a two-stage fixed-charge transportation problem. Informatica, 2020, vol. 31, iss. 4, pp. 681-706. DOI: 10.15388/20-INFOR432.

Oyewole, G. J., Adetunji, O. A Hybrid Algorithm To Solve The Fixed Charge Solid Location And Transportation Problem. Engineering Heritage Journal (GWK), 2021, vol. 5, iss. 1, pp. 1-11. DOI: 10.26480/gwk.01.2021.01.11.

Kurennov, S., Barakhov, K., Vambol, O. Topological optimization of a symmetrical adhesive joint. Island model of genetic algorithm. Radioelectronic and Computer Systems, 2022, iss. 3, pp. 67-83. DOI: 10.32620/reks.2022.3.05.

Powell, M. J. D. On search directions for minimization algorithms. Mathematical programming, 1973, vol. 4, pp. 193-201. DOI: 10.1007/BF01584660.

The Retrospective Image Registration Evaluation Project. Available at: https://rire.insight-journal.org/. (accessed 10 November 2022).




DOI: https://doi.org/10.32620/reks.2023.1.10

Refbacks

  • There are currently no refbacks.