ChatGPT-4o Proves Effective in Accurately Diagnosing Dermoscopic Images of Benign and Malignant Skin Conditions

Main Article Content

Ryan Scheinkman
Lea Tordjman
Lauren Dender
Daniel Green
Mascha Korsch
Keyvan Nouri

Keywords

Dermoscopy, Artificial Intelligence, ChatGPT, Melanoma, Squamous Cell Carcinoma, Basal Cell Carcinoma

Abstract

Introduction: The integration of artificial intelligence (AI) and AI chatbots (AIC) into medicine is progressing rapidly, particularly within dermatology, where clinical, dermoscopic, and histological pattern recognition is essential.


Methods: To assess the diagnostic capabilities of ChatGPT-4o, ten skin lesions were selected: basal cell carcinoma (BCC), melanoma, invasive squamous cell carcinoma (SCC), actinic keratosis (AK), cherry angioma (CA), solar lentigo (SL), seborrheic keratosis (SK), blue nevus (BN), dermatofibroma (DF), and lichen planus (LP). For each condition, fifteen dermoscopic images were sourced from DermNet NZ and Dermoscopedia, yielding a total of 150 images. Rank order top 5 differential diagnosis were generated for each image and sensitivity, specificity, and accuracy were computed for each.


Results: ChatGPT-4o correctly diagnosed 117 out of 150 (78%) images at the first attempt, and 144 out of 150 (96%) images within the top five differential diagnoses. Melanoma was correctly identified on initial diagnosis (15/15, 100% sensitivity, 91.1% specificity, 91.99% accuracy).


Discussion: Our research demonstrates the promising potential diagnostic capabilities of ChatGPT-4o in accurately identifying various benign and malignant skin lesions using dermoscopic images, novel findings in comparison to prior studies

References

1. Mahmoud NM, Soliman AM. “Early automated detection system for skin cancer diagnosis using artificial intelligent techniques”. Sci Rep. 2024;14(1):9749. Published 2024 Apr 28. doi:10.1038/s41598-024-59783-0

2. Cortes J, Paravar T, Oldenburg R. Physician Opinions on Artificial Intelligence Chatbots In Dermatology: A National Online Cross-Sectional Survey of Dermatologists. J Drugs Dermatol. 2024;23(11):972-978. doi:10.36849/JDD.8239

3. Demand Sage. ChatGPT statistics: Key facts and figures. Published November 2024. Accessed November 4, 2024. Available from: https://www.demandsage.com/chatgpt-statistics/#:~:text=As%20of%20November%202024%2C%20ChatGPT,reached%20an%20all%2Dtime%20high.

4. Shifai N, van Doorn R, Malvehy J, Sangers TE. Can ChatGPT vision diagnose melanoma? An exploratory diagnostic accuracy study. J Am Acad Dermatol. 2024;90(5):1057-1059. doi:10.1016/j.jaad.2023.12.062