Convolutional neural network-based skin cancer classification with transfer learning models
Abstract
Skin cancer is a medical condition characterized by abnormal growth of skin cells. This occurs when the DNA within these skin cells becomes damaged. In addition, it is a prevalent form of cancer that can result in fatalities if not identified in its early stages. A skin biopsy is a necessary step in determining the presence of skin cancer. However, this procedure requires time and expertise. In recent times, artificial intelligence and deep learning algorithms have exhibited superior performance compared with humans in visual tasks. This result can be attributed to improved processing capabilities and the availability of vast datasets. Automated classification driven by these advancements has the potential to facilitate the early identification of skin cancer. Traditional diagnostic methods might overlook certain cases, whereas artificial intelligence-powered approaches offer a broader perspective. Transfer learning is a widely used technique in deep learning, involving the use of pre-trained models. These models are extensively implemented in healthcare, especially in diagnosing and studying skin lesions. Similarly, convolutional neural networks (CNNs) have recently established themselves as highly robust autonomous feature extractors that can achieve excellent accuracy in skin cancer detection because of their high potential. The primary goal of this study was to build deep-learning models designed to perform binary classification of skin cancer into benign and malignant categories. The tasks to resolve are as follows: partitioning the database, allocating 80% of the images to the training set, assigning the remaining 20% to the test set, and applying a preprocessing procedure to the images, aiming to optimize their suitability for our analysis. This involved augmenting the dataset and resizing the images to align them with the specific requirements of each model used in our research; finally, building deep learning models to enable them to perform the classification task. The methods used are a CNNs model and two transfer learning models, i.e., Visual Geometry Group 16 (VGG16) and Visual Geometry Group 19 (VGG19). They are applied to dermoscopic images from the International Skin Image Collaboration Archive (ISIC) dataset to classify skin lesions into two classes and to conduct a comparative analysis. Our results indicated that the VGG16 model outperformed the others, achieving an accuracy of 87% and a loss of 38%. Additionally, the VGG16 model demonstrated the best recall, precision, and F1- score. Comparatively, the VGG16 and VGG19 models displayed superior performance in this classification task compared with the CNN model. Conclusions. The significance of this study stems from the fact that deep learning-based clinical decision support systems have proven to be highly beneficial, offering valuable recommendations to dermatologists during their diagnostic procedures.
Keywords
Full Text:
PDFReferences
Akyel, C., & Arici, N. Cilt Kanserinde Kıl Temizliği ve Lezyon Bölütlemesinde Yeni Bir Yaklaşım[A New Approach to Hair Noise Cleansing and Lesion Segmentation in Images of Skin Cancer]. Politeknik Dergisi, 2020, vol. 23, no. 3, pp. 821-828. DOI: 10.2339/politeknik.645395. (in Turkish)
Dildar, M., Akram, S., Irfan, M., Khan, H. U., Ramzan, M., Mahmood, A. R., Alsaiari, S. A., Saeed, A. M., Alraddadi, M. O., & Mahnashi, M. H. Skin Cancer Detection: A Review Using Deep Learning Techniques. International Journal of Environmental Research and Public Health, 2021, vol. 18, no. 10, article no. 5479.DOI: 10.3390/ijerph18105479.
Better Health Channel: Melanoma. Available at https://www.betterhealth.vic.gov.au/health/conditionsandtreatments/melanoma#what-is-melanoma.(accessed 22.06.23).
Naqvi, M., Gilani, S. Q., Syed, T., Marques, O., & Kim, H. C. Skin Cancer Detection Using Deep Learning – A Review. Diagnostics, 2023, vol. 13, no. 11, article no. 1911. DOI: 10.3390/diagnostics13111911.
Chuchu, N., Dinnes, J., Takwoingi, Y., Matin, R. N., Bayliss, S. E., Davenport, C., Moreau, J. F., Bassett, O., Godfrey, K., O'Sullivan, C., Walter, F. M., Motley, R., Deeks, J. J., & Williams, H. C. Teledermatology for diagnosing skin cancer in adults. Cochrane Database of Systematic Reviews, 2018, iss. 12, article no. CD013193. DOI: 10.1002/14651858.CD013193.
Maglogiannis, I., & Doukas, C. N. Overview of Advanced Computer Vision Systems for Skin Lesions Characterization. IEEE Transactions on Information Technology in Biomedicine,2009, vol. 13, no. 5, pp. 721–733. DOI: 10.1109/TITB.2009.2017529.
Ali, M. S., Miah, M. S., Haque, J., Rahman, M. M., & Islam, M. K. An enhanced technique of skin cancer classification using deep convolutional neural network with transfer learning models. Machine Learning with Applications, 2021, vol. 5, article no. 100036. DOI: 10.1016/j.mlwa.2021.100036.
Moskalenko, V. V., Moskalenko, A. S., Korobov, A. H., Zaretsʹkyy, M. O., & Semashko, V. A. Modelʹ ta alhorytm navchannya systemy detektuvannya malorozmirnykh obʺyektiv dlya malohabarytnykh bezpilotnykh litalʹnykh aparativ [A model and learning algorithm of small-sized object detection system for compact drones]. Radioelektronni i komp'uterni sistemi – Radioelectronic and computer systems, 2018, no. 4, pp. 41–52. DOI: 10.32620/reks.2018.4.04. (in Ukrainian)
Hazra, S. K., Ema, R. R., Galib, S. M., Kabir, S., & Adnan, N. Emotion recognition of human speech using deep learning method and MFCC features. Radioelektronni i komp'uterni sistemi – Radioelectronic and computer systems, 2022, no. 4, pp. 161–172. DOI: 10.32620/reks.2022.4.13.
Krivtsov, S., Meniailov, I., Bazilevych, K., & Chumachenko, D. Predictive model of COVID-19 epidemic process based on neural network. Radioelektronni i komp'uterni sistemi – Radioelectronic and computer systems, 2022, no. 4, pp. 7–18. DOI: 10.32620/reks.2022.4.01.
Nigar, N., Wajid, A., Islam, S., & Shahzad, M. K. Skin cancer classification: a deep learning approach. Pakistan Journal of Science, 2023, vol. 75, no. 02, pp. 210-218. DOI: 10.57041/pjs.v75i02.851.
Jaisakthi, S. M., Mirunalini, P, Chandrabose, A., & Rajagopal, A. Classification of skin cancer from dermoscopic images using deep neural network architectures. Multimed Tools Appl, 2023, vol. 82, pp. 15763-15778. DOI: 10.1007/s11042-022-13847-3
Albawi, S., Arif, M. H., & Waleed. J. Skin cancer classification dermatologist-level based on deep learning model. Acta Scientiarum Technology, 2023, vol. 45, pp. e61531‑e61531. DOI: 10.4025/actascitechnol.v45i1.61531.
Mahbod, A., Schaefer, G., Wang, C., Dorffner, G., Ecker, R., & Ellinger, I. Transfer learning using a multi-scale and multi-network ensemble for skin lesion classification. Computer Methods and Programs in Biomedicine, 2020, vol. 193, article no. 105475. DOI: 10.1016/j.cmpb.2020.105475.
Rodrigues, D. A., Ivo, R. F., Satapathy, S. C., Wang, S., Hemanth, J., & Filho, P. P. R. A new approach for classification skin lesion based on transfer learning, deep learning, and IoT system. Pattern Recognition Letters, 2020, vol. 136, pp. 8–15. DOI: 10.1016/j.patrec.2020.05.019.
Hosny, K. M., Kassem, M. A., & Foaud, M. M. Classification of skin lesions using transfer learning and augmentation with Alex-net. PLOS ONE, 2019, vol. 14 no. 5, article no. e0217293. 17 p. DOI: 10.1371/journal.pone.0217293.
Singhal, A., Shukla, R., Kankar, P. K., Dubey, S., Singh, S., & Pachori, R. B. Comparing the capabilities of transfer learning models to detect skin lesion in humans. Proceedings of the Institution of Mechanical Engineers, Part H: Journal of Engineering in Medicine, IMECHE, 2020, vol. 234, no. 10, pp. 1083–1093. DOI: 10.1177/0954411920939829.
Arora, G., Dubey, A. K., Jaffery, Z. A., & Rocha, A. A comparative study of fourteen deep learning networks for multi skin lesion classification (MSLC) on unbalanced data. Neural Computing and Applications, 2023, vol. 35, no. 11, pp. 7989–8015. DOI: 10.1007/s00521-022-06922-1.
Kausar, N., Hameed, A., Sattar, M., Ashraf, R., Imran, A. S., Abidin, M. Z. Ul., & Ali, A. Multiclass Skin Cancer Classification Using Ensemble of Fine-Tuned Deep Learning Models. Applied Sciences, 2021, vol. 11, iss. 22, article no. 10593. DOI: 10.3390/app112210593.
Tahir, M., Naeem, A., Malik, H., Tanveer, J., Naqvi, R. A., & Lee, S.-W. DSCC_Net: Multi-Classification Deep Learning Models for Diagnosing of Skin Cancer Using Dermoscopic Images. Cancers, 2023, vol. 15, no. 7, article no. 2179. DOI: 10.3390/cancers15072179.
Islam, M. Al-H., Shahriyar, S. M., Alam, M. J., Rahman, M., & Sarker, M. R. K. R. Skin disease detection employing transfer learning approacha fine-tune visual geometry group-19. Indonesian Journal of Electrical Engineering and Computer Science, 2023, vol. 31, no. 1, pp. 321-328. DOI:10.11591/ijeecs.v31.i1.pp321-328.
Nugroho, A. A., Slamet, I., & Sugiyanto. Skins cancer identification system of HAMl0000 skin cancer dataset using convolutional neural network. AIP Conference Proceedings, 2019, vol. 2202, no. 1, article no. 020039. DOI: 10.1063/1.5141652.
Codella, N. C. F., Gutman, D., Celebi, M. E., Helba, B., Marchetti, M. A., Dusza, S. W., Kalloo, A., Liopyris, K., Mishra, N., Kittler, H., & Halpern, A. Skin lesion analysis toward melanoma detection: A challenge at the 2017 International symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC). Proceeding of 2018 IEEE 15th International Symposium on Biomedical Imaging, 2018, pp. 168-172. DOI: 10.1109/ISBI.2018.8363547.
Farooq, A., Jia, X., Hu, J., & Zhou, J. Knowledge Transfer via Convolution Neural Networks for Multi-Resolution Lawn Weed Classification. Proceeding of the 2019 10th Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing, 2019, pp. 01-05. DOI: 10.1109/WHISPERS.2019.8920832.
The International Skin Imaging Collaboration. Available at:https://www.isic-archive.com/ (accessed 10.05.2023).
Zheng, Y., Yang, C., & Merkulov, A.Breast cancer screening using convolutional neural network and follow-up digital mammography. Computational Imaging III, SPIE, 2018, vol. 10669, article no. 1066905. DOI:10.1117/12.2304564.
Leung, K. How to Easily Draw Neural Network Architecture Diagrams. Towards data science. Available at: https://towardsdatascience.com/how-to-easily-draw-neural-network-architecture-diagrams-a6b6138ed875 (accessed 10.05.2023).
Oumoulylte, M., El Allaoui, A., Farhaoui, Y., Amounas, F., & Qaraai, Y. Deep Learning Algorithms for Skin Cancer Classification. Artificial Intelligence and Smart Environment. ICAISE 2022. Lecture Notes in Networks and Systems, Springer, Cham, 2022, vol. 635, pp. 345-351. DOI: 10.1007/978-3-031-26254-8_49.
The Keras ecosystem. Available at: https://keras.io/(accessed 10.05.2023).
Optimizer that implements the Adam algorithm. Available at: http://keras.io/api/optimizers/adam/(accessed 10.05.2023).
Ibrahim, A., Elbasheir, M., Badawi, S., Mohammed, A., & Alalmin, A. Skin Cancer Classification Using Transfer Learning by VGG16 Architecture (Case Study on Kaggle Dataset). Journal of Intelligent Learning Systems and Applications, 2023, vol. 15, no. 3, pp. 67-75. DOI: 10.4236/jilsa.2023.153005.
Arshed, M. A., Mumtaz, S., Ibrahim, M., Ahmed, S., Tahir, M., & Shafi, M. Multi-Class Skin Cancer Classification Using Vision Transformer Networks and Convolutional Neural Network Based Pre-Trained Models. Information, 2023, vol. 14, iss. 7. DOI: 10.3390/info14070415.
DOI: https://doi.org/10.32620/reks.2023.4.07
Refbacks
- There are currently no refbacks.