Error: 429: HTTP/2 429 Error: 429: HTTP/2 429 Objective Measures Needed: Dermatology Program Directors' Perspectives on the USMLE Step 1 Pass/Fail Transition - JDDonline - Journal of Drugs in Dermatology

Objective Measures Needed: Dermatology Program Directors’ Perspectives on the USMLE Step 1 Pass/Fail Transition

April 2026 | Volume 25 | Issue 4 | 9373 | Copyright © April 2026


Published online March 30, 2026

Om U. Patel MDa, Kaitlin G. Burge MDa, Ishant S. Yadav MDa, William K. Haynes MDa, Jason Patel MDa, Nicholas J. Van Wagoner MD PhDa,b, Lauren C.S. Kole MDc

aSchool of Medicine, University of Alabama at Birmingham, Birmingham, AL
bDivision of Infectious Diseases, Department of Medicine, University of Alabama at Birmingham, AL
cDepartment of Dermatology, University of Alabama at Birmingham, Birmingham, AL

Abstract
Background: Since January 2022, the United States Medical Licensing Examination (USMLE) Step 1 discontinued reporting a 3-digit score. The objective of this study is to share survey results and to communicate the changes Dermatology residency program directors (PDs) will make to evaluate candidates.
Methods: The research team conducted an online survey of PDs and analyzed the responses using R programming and MATLAB scripts. Chi-squared tests were used to identify significant differences in responses to multiple-choice questions, while paired t tests were utilized to compare pre- and post-values for criteria ranking questions.
Results: Following the implementation of a pass/fail grading system for Step 1, many PDs will place greater emphasis on Step 2 CK (Clinical Knowledge) scores to differentiate among candidates. Some believe that medical schools should also disclose National Board of Medical Examiners (NBME) shelf exam scores and factor in a student's medical school ranking.
Conclusion: The added emphasis on Step 2 CK scores, NBME shelf exam scores, a student's medical institution, and class rank may cloud the positive impacts of this change, providing an opportunity for programs to evaluate students more holistically.

 

INTRODUCTION

The United States Medical Licensing Examination (USMLE) will stop reporting a 3-digit numerical score and begin reporting a pass/fail outcome at the end of January 2022.1,2 The proposal for this change is to eliminate the major emphasis placed by program directors (PDs) on USMLE performance as a tool for residency screening.2,3 This change was made to allow medical schools to focus on educating physicians rather than teaching to standardized examinations, allowing PDs to use selection factors that truly represent potential in a given specialty.4 The purpose of this study was to assess the opinions of Dermatology residency program directors on USMLE examinations' current ability to predict clinical performance and specialty board examination performance, the relative importance of USMLE Step 1 in current selection of residents, and how the change of USMLE Step 1 to pass/fail will change the relative importance of other factors in residency selection.

MATERIALS AND METHODS

Medical students and physicians at our institution conducted a study to examine the predictive outcomes of the United States Medical Licensing Exam (USMLE) Step 1 transitioning to pass/fail under IRB-300007220 "Predictive Outcomes of USMLE Step 1 Transitioning to Pass/Fail". The study was conducted using an anonymous Qualtrics XM® online survey that was distributed via email and through the APD Program Director's listserv for a total of 6 weeks. These respondents were asked to rank 16 different factors, including Step 1 score, in terms of their importance for assessing applicants both before and after the change to a pass/fail system. The factors were ranked on a scale of 1 to 17 (1 being the most important) before the change and 1 to 16 after the change, with Step 1 score being removed as a factor to consider. The factors included in the ranking were: Step 1 score, publications and presentations, research experience, volunteer experience, membership in Alpha Omega Alpha, membership in the Gold Humanism Honor Society, the Dean's letter, personal statement, clerkship grades, preclinical grades, class rank, away rotations, letters of recommendation, graduate degree, Step 2 score, leadership experience, and attendance at a top 40 National Institutes of Health-funded medical school. Custom programming scripts in R and MATLAB were used to analyze the responses, and statistical tests were conducted to determine the significance of the results. Responses were analyzed using nonoverlapping 99.9% confidence intervals, which were used to determine significance for multiple choice questions, and independent t tests were used to analyze ranking questions with significance at P<.001.