Improving the segmentation of the vertebrae using a multi-stage machine learning algorithm

Vladyslav Koniukhov

Abstract


The health of the spine is an integral part of human health because the spine itself plays one of the key roles in human health, and diseases such as osteoporosis, vertebral injuries, herniated intervertebral discs, and other diseases can not only complicate a person's life but also have serious consequences. The use of X-ray images to diagnose spinal diseases plays a key role in diagnosis. Diagnosis of diseases with the help of X-rays is the most popular and cheapest option for patients to detect pathologies and diseases. The subjects of this article are algorithms for the segmentation of X-ray images of various qualities. The aim is to research the possibility of improving segmentation of vertebrae:  Th8, Th9, Th10, Th11 using a multi-stage method of segmentation of the spine using machine learning to improve the accuracy of automation of vertebrae segmentation. Task: train a neural network that will segment the incoming X-ray image and produce a mask of the area of four vertebrae at the output; train a neural network that will segment each vertebra in the area found at the previous stage; cut out a section with one vertebra and train a neural network that will segment it; create an algorithm that, based on three previously trained neural networks, will segment vertebrae on an X-ray image. The following methods were used: a multi-stage approach using machine learning. The following results were obtained: thanks to segmentation in several stages, it was possible to reduce the region of interest, thereby removing unnecessary background when using segmentation. Using this algorithm for 48 vertebrae, an average improvement in segmentation accuracy of 4.83% was obtained. Conclusions. In this research, a multi-stage algorithm was proposed, and an improvement in the accuracy of segmentation of X-ray images in the lateral projection, namely the accuracy of all four vertebrae: Th8, Th9, Th10, Th11 - was obtained. The results demonstrate that the use of this method gives a better result than the usual segmentation of the input image.


Keywords


artificial intelligence; machine learning; image recognition; neural network; image segmentation, computer vision

Full Text:

PDF

References


Jamaludin, A., Kadir, T., & Zisserman, A. SpineNet: Automated classification and evidence visualization in spinal MRIs. Medical Image Analysis, 2017, no. 41, pp. 63-73. DOI: 10.1016/j.media.2017.07.002.

Otsu, N. A Threshold Selection Method from Gray-Level Histograms. IEEE Transactions on Systems, Man, and Cybernetics, 1979, vol. 9, no. 1, pp. 62-66. DOI: 10.1109/TSMC.1979.4310076.

Feng, Y., Zhao, H., Li, X., Zhang, X. & Li, H. A multi-scale 3D Otsu thresholding algorithm for medical image segmentation. Digital Signal Processing, 2017, vol. 60, pp. 186-199. DOI: 10.1016/j.dsp.2016.08.003.

Feng, Y., Liu, W., Zhang, X., Liu, Z., Liu, Y., & Wang, G. An interval iteration based multilevel thresholding algorithm for brain MR image segmentation. Entropy, 2021, vol. 23, no. 11, pp. 22-51. DOI: 10.3390/e23111429.

Maolood, I., Al-Salhi, Y., & Lu, S. Thresholding for medical image segmentation for cancer using fuzzy entropy with level set algorithm. Open Medicine, 2018, vol. 13, pp. 374-383. DOI: 10.1515/med-2018-0056.

Stolojescu-Crisan, C., & Holban, S. An interactive X-ray image segmentation technique for bone extraction. International Work-Conference on Bioinformatics and Biomedical Engineering, Granada, Spain, 2014, vol. 2, pp. 1164-1171.

Yao, W., Bai, J., Liao, W., Chen, Y., Liu, M., & Xie, Y. From CNN to Transformer: A review of medical image segmentation models. Journal of Imaging Informatics in Medicine, 2023, pp. 1-18. DOI: 10.48550/arXiv.2308.05305.

Aylett-Bullock, J., Cuesta-Lázaro, C., & Quera-Bofarull, A. XNet: A convolutional neural network (CNN) implementation for medical X-ray image segmentation suitable for small datasets. Proc. SPIE 10953, Medical Imaging 2019: Biomedical Applications in Molecular, Structural, and Functional Imaging, San Diego, California, United States, 2019, vol. 10953, pp. 453-463. DOI: 10.1117/12.2512451.

Hansen, L. K. & Salamon, P. Neural network ensembles. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1990, vol. 12, iss. 10, pp. 993-1001. DOI: 10.1109/34.58871.

Windsor, R., Jamaludin, A., Kadir, T., & Zisserman, A. A convolutional approach to vertebrae detection and labelling in whole spine MRI. International Conference on Medical Image Computing and Computer-Assisted Intervention, Lima, Peru, 2020, pp. 712–722. DOI: 10.48550/arXiv.2007.02606.

Ebrahimi, S., Gajny, L., Skalli, W., & Angelini, E. D. Vertebral corners detection on sagittal X-rays based on shape modelling, random forest classifiers and dedicated visual features. Computational Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, 2019, vol. 7, iss. 2, pp. 132-144. DOI: 10.1080/21681163.2018.1463174.

Gaonkar, B., Xia, Y., Villaroman, D. S., Ko, A., Attiah, M., Beckett, J. S., & Macyszyn, L. Multi-parameter ensemble learning for automated vertebral body segmentation in heterogeneously acquired clinical MR images. IEEE Journal of Translational Engineering in Health and Medicine, 2017, vol. 5, pp. 1-12. DOI: 10.1109/JTEHM.2017.2717982.

Lu, H., Li, M., Yu, K., Zhang, Y., & Yu, L. Lumbar spine segmentation method based on deep learning. Journal of Applied Clinical Medical Physics, 2023, vol. 24, iss. 6, pp. 1-12. DOI: 10.1002/acm2.13996.

Xiong, X., Graves, S.A., Gross, B.A., Buatti, J. M., Beichel, R. R. Lumbar and Thoracic Vertebrae Segmentation in CT Scans Using a 3D Multi-Object Localization and Segmentation CNN. Tomography, 2024, vol. 10, no. 5, pp. 738-760. DOI: 10.3390/tomography10050057.

Da Mutten, R., Zanier, O., Theiler, S., Ryu, S. J., Regli, L., Serra, C., & Staartjes, V. E. Whole Spine Segmentation Using Object Detection and Semantic Segmentation. Neurospine, 2024, vol. 21, iss. 1, pp. 57–67. DOI: 10.14245/ns.2347178.589.

Liang, Y. W., Fang, Y. T., Lin, T. C., Yang, C. R., Chang, C. C., Chang, H. K., Ko, C. C., Tu, T. H., Fay, L. Y., Wu, J. C., Huang, W. C., Hu, H. W., Chen, Y. Y., & Kuo, C. H. The Quantitative Evaluation of Automatic Segmentation in Lumbar Magnetic Resonance Images. Neurospine, 2024, vol. 21, iss. 2, pp. 665–675. DOI: 10.14245/ns.2448060.030.

Kim, K. C., Cho, H. C., Jang, T. J., Choi, J. M., & Seo, J. K. Automatic detection and segmentation of lumbar vertebrae from X-ray images for compression fracture evaluation. Computer Methods and Programs in Biomedicine, 2021, vol. 200, pp. 1-18. DOI: 10.1016/j.cmpb.2020.105833.

Shelhamer, E., Long, J., & Darrell, T. Fully convolutional networks for semantic segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, vol. 39, no. 4, pp. 640-651. DOI: 10.1109/TPAMI.2016.2572683.

Vindr.ai. (n.d.). Vindr.ai Datasets: SpineXR. Available at: https://vindr.ai/datasets/spinexr (Accessed: 16.06.2024).

Wang, H., Zhang, T., Cheung, K. M., & Shea, G. K. Application of deep learning upon spinal radiographs to predict progression in adolescent idiopathic scoliosis at first clinic visit. EClinicalMedicine, 2021, vol. 42, pp. 1-9. DOI: 10.1016/j.eclinm.2021.101220.




DOI: https://doi.org/10.32620/reks.2024.4.07

Refbacks

  • There are currently no refbacks.