Diagnosis of Skin Disease in Moderately to Highly Pigmented Skin by Artificial Intelligence

July 2023 | Volume 22 | Issue 7 | 647 | Copyright © July 2023


Published online June 28, 2023

Justine G. Schneider BSa,b, Adam J. Mamelak MDc, Izhaar Tejani BAc, Tory Jarmain BAc, Ronald L. Moy MDa

aResearch Department, Moy-Fincher-Chipps Facial Plastics & Dermatology, Beverly Hills, CA 
bDermatology Department, The Ohio State University College of Medicine, Columbus, OH
cTriage USA LLC., West Hollywood, CA

Abstract
Background: Triage of patients with skin diseases often includes an initial assessment by a nurse or general practitioner, followed by a dermatologist. Artificial intelligence (AI) systems have been reported to improve clinician ability to diagnose and triage skin conditions. Previous studies have also shown that diagnosis in patients with skin of color can be more challenging.
Purpose: This study seeks to determine the performance of AI in the screening and triage of benign-neoplastic, malignant-neoplastic, and non-neoplastic skin conditions for Fitzpatrick skin types IV-VI.
Methods: A set of 163 non-standardized clinical photographs of skin disease manifestations from patients with Fitzpatrick skin types IV-VI were obtained through a publicly available dataset (Scale AI and MIT Research Lab, “Fitzpatrick 17 Dataset”). All photos were diagnosed by a specialist and categorized into three disease classes: benign-neoplastic, malignant-neoplastic, or non-neoplastic. There were 23, 14, and 122 cases of each disease class, respectively.
Results: Overall, the AI was able to classify the disease classes with a high degree of accuracy for the Top 1 diagnosis (86.50%). Based on its first prediction, the AI demonstrated the greatest accuracy when classifying non-neoplastic conditions (90.98%), high accuracy in detecting malignant-neoplastic conditions (77.78%), and moderate accuracy of classifying benign-neoplastic conditions (69.57%). Conclusion: The AI had an overall accuracy of 86.50% in diagnosing skin disease in Fitzpatrick skin types IV to VI. This is an improvement over reported clinician diagnostic accuracy of 44.3% in darker skin types. Incorporating AI into front-line screening of skin conditions could thereby assist in patient triage and shorten the time to accurate diagnosis.

Schneider LG, Mamelak AJ, Tejani I, et al. Diagnosis of skin disease in moderately to highly pigmented skin by artificial intelligence. J Drugs Dermatol. 2023;22(7):647-652. doi:10.36849/JDD.7581.

INTRODUCTION

Early diagnosis of skin disease, especially malignant neoplasms, can significantly reduce patient morbidity and mortality. Assessment of most skin conditions is often first performed by a nurse and/or general practitioner before a subsequent referral to a dermatologist is made. Previous publications by numerous groups report the ability of custom-built Artificial Intelligence (AI) systems to help assess skin conditions.1-6

In 2021, Jain et al examined the use of Google’s AI-based algorithm by primary care physicians and claimed it could improve the triage of skin conditions.7 The study however severely underrepresented patients with more highly pigmented skin. Specifically, the AI was validated on only 15 out of 152 (9.9% of total) histologically verified cases of skin conditions in Fitzpatrick skin types IV and V and no histologically verified cases of the darkest Fitzpatrick skin type (VI). Due to the class imbalance present, the test set was heavily skewed towards the 3 lightest skin types with 90.1% of the data representing 50% of the Fitzpatrick classes (I-III), while only 9.9% of the data represented the other 50% of the Fitzpatrick classes (IV-VI). These investigators did not generate sufficient evidence to support the study’s conclusion.

Recent studies have also highlighted the decreased diagnostic accuracy among clinicians and clinician-trainees on photos of patients with skin of color (SOC).8-10 Specifically, Diao et al reported that the diagnostic accuracy of identifying cutaneous/subcutaneous pathology in darker skin types was significantly lower at 44.3% compared with 50.5% in intermediate skin and 50.4% in light skin.8  This is likely due to poor representation of SOC in textbooks and instructional guides, comprising as low as 4% to 18% of the total number of photos in these teaching materials.11 Furthermore, previous studies have reported that people with SOC have worse prognoses and lower survival rates compared to individuals with light skin. These poorer patient outcomes are due to delayed or incorrect diagnoses.12-16