The new Phase 1 Exam Review Committee has been tasked with reviewing the multiple-choice exams and offering recommendations to improve exam items.
These reviews will ensure that students are mastering the Phase 1 content and help prepare them to do well on USMLE Step 1. The committee also will work toward standardizing exam items based on best practices related to question writing and item format.
To achieve these goals, items will be reviewed using item-level statistics and NBME format and structure guidelines.
The committee’s first round of review for Phase 1 exams will focus on items in each block exam that underperformed psychometrically in the academic year 2021-2022.
Assessment coordinator Tamra Nielson will provide faculty and block directors with feedback from the committee prior to exam day. Faculty and block directors then will work together to review and address the committee’s comments. During this time, faculty also will be asked to submit one new question for every lecture hour. The committee will review new questions on a rolling basis before inclusion in the next iteration of the examination.
"This peer review process is the norm for many national organizations and provides an opportunity for faculty members to learn about test writing and related best practices," said Geoffrey Talmon, MD, the associate dean for medical education for the UNMC College of Medicine. "The efforts of this committee are critical to helping our examinations truly assess students' knowledge and better prepare them for certifying examinations to follow."
Currently, the committee is composed of 10 members, consisting of basic scientists, clinicians and block directors with expertise across specialties. The work to improve exam items will be ongoing and iterative, Dr. Talmon said.
For additional information, please contact Kirstie Bash, PhD, or Geoffrey Talmon, MD.