"Never doubt that a small group of thoughtful, committed citizens can change the world. Indeed, it is the only thing that ever has."

Margaret Mead
Original article
peer-reviewed

Correlation of Medical College Admission Test Scores and Self-assessment Materials with the United States Medical Licensing Examination Step 1 Performance



Abstract

Purpose

Candidates' performance on the United States Medical Licensing Examination (USMLE) Step 1 examination had been correlated with the Medical College Admission Test (MCAT). However, in 2015, a new MCAT format was released and its correlation with Step 1 remains to be fully analyzed. Preparation for Step 1 typically involves purchasing and perusing practice tests from the National Board of Medical Examiners (NBME) and UWorld; however, their predictive value to performance on Step 1 remains to be ascertained, especially with the release of five new NBME practice tests. Additionally, there is a need for accurately predicting Step 1 scores to self-evaluate study progress and reduce student anxiety.

Rationale

Program directors rank USMLE Step 1 scores as the number one criterion in selecting interviewees for residency. Step 1 scores are more important than Step 2 scores, Dean’s letter, or other letters of recommendation in determining the overall ranking of a candidate after interviews.

Hypotheses

The authors hypothesized that the new MCAT scores correlated positively with Step 1 scores and that the new NBME practice tests were more predictive of performance on Step 1 as compared to old NBME tests. 

Methods

Linear regression analysis followed by either analysis of variance (ANOVA) or Student's t-tests were used to analyze 399 responses. Data obtained was used to update an existing Step 1 score predictor, which was then validated.

Results

A positive correlation between the MCAT (average score: 510.1 ± 6.3) and Step 1 scores (average score: 246.1 ± 14.2) was observed. While new NBME practice tests were more predictive of Step 1 scores than old NBME tests, UWorld test scores were the most predictive. Students who practiced with the new NBME practice tests scored significantly higher than students who did not use them. However, students using any of the UWorld practice tests did significantly better than students who practiced using only NBME practice tests but not UWorld practice tests. Ironically, NBME 16, the second-most correlative test to Step 1 performance, is no longer available for purchase. Overall, taking six or more practice tests significantly enhanced Step 1 scores; the optimal number of tests was found to be between six and nine. The predicted score by an updated Step 1 score predictor was within 3.8 points or 1.6% of the actual Step 1 score.

Conclusions

We believe this study will aid in the selection and purchase of appropriate self-assessment tests as preparatory material for the USMLE Step 1 examination. It will also introduce them to an existing Step 1 score predictor that will help determine their readiness for Step 1.

Introduction

The United States Medical Licensing Examination (USMLE), sponsored by the Federation of State Medical Boards (FSMB) and the National Board of Medical Examiners (NBME), consists of three examinations or “steps” that assess medical student and resident competency for practicing safe medicine in the United States [1]. Step 1 tests basic science concepts while Step 2 evaluates clinical knowledge [2]. Step 3 is taken during the first year of residency and evaluates the application of medical knowledge to the supervised practice of medicine. Of these, Step 1 scores have been shown to play an important role in residency selection by standardizing academic achievements of students from different schools, in predicting success in clinical clerkships and Step 2 examinations, and in board examinations taken during residencies [3-9]. Therefore, parameters influencing student performance on Step 1 examinations such as the Medical College Admission Test (MCAT) and related preparatory materials are of interest to both students as well as medical schools.

The MCAT is a standardized examination that forms an integral part of the application process to medical schools across the United States. Along with undergraduate grade point average (GPA) and extracurricular activities such as shadowing physicians, recommendation letters, and a personal statement, the MCAT is a critical component of medical school admissions [10]. The MCAT not only provides the admissions committees with an objective leveling metric for evaluating candidates from different schools with variable GPAs but has also been shown to positively correlate with performance on USMLE Step 1 [11-13]. However, the format and scoring of the MCAT were modified extensively in April 2015 from a three-section test with a maximum possible score of 45 to a four-section test with a maximum possible score of 528. The fourth section in the 2015 edition focused on psychology and sociology. While scores on the new MCAT format have been recently correlated with performance in the first year of medical school, only one recent study, at the University of Minnesota Medical School-Twin Cities, has correlated the scores on the new MCAT format with Step 1 scores [14,15]

Another important factor influencing Step 1 scores is the use of specific study and evaluation materials while preparing for the examination, such as question banks. Indeed, the use of question banks has a positive effect on Step 1 scores, especially for those with lower MCAT scores [16-19]. Similarly, performance on self-assessment tests may also help predict Step 1 scores [18]. These practice tests are provided by NBME, known as Comprehensive Basic Science Self-Assessment (CBSSA), as well as other companies such as UWorld. While previous studies have established a positive correlation between NBME CBSSA scores and Step 1 scores, NBME discontinued several of these tests in spring 2019 and introduced five new practice examinations [18]. Specifically, five old practice examinations were retired (Forms 13, 15, 16, 17, and 19) and were replaced by five new practice examinations (Forms 20-24); the correlation of these new tests with Step 1 performance is not yet known. Similarly, UWorld also provides students with question banks such as QBank and practice tests such as UWorld Self Assessment 1 (UWSA1) and UWorld Self Assessment 2 (UWSA2), which are widely used. Correlations of these self-assessment tests with Step 1 scores will help identify specific tests that can closely predict performance on Step 1 examinations and allow students to gauge their progress during their preparations. Since there is a cost associated with each test, it also becomes important to determine the minimum number of practice tests required to optimize Step 1 performance.

Given the importance of Step 1 in matching residency and the consequent student anxiety, attempts have been made to create score predictors that use the correlation between MCAT and question banks with Step 1 scores [20]. For example, a model was developed using scores on the Comprehensive Basic Science Examination (CBSE; a scored test administered by NBME and taken by medical students to prepare for Step 1), UWorld QBank, first-year grades, and financial need [17]. This model was able to explain 62.3% of the variance in Step 1 scores and was a good first step; however, this model required values for each of these variables for prediction such that students at a school that did not offer CBSE or provided “Pass” or “Fail” grades instead of letter grades would be unable to benefit. Interestingly, a score predictor was posted on the web forum, Reddit (https://www.reddit.com), that appeared to closely predict Step 1 scores without requiring a student to enter every variable. This score predictor took into account practice examination scores from NBME and UWorld, in addition to question bank scores from Kaplan, UWorld, and USMLE-Rx. However, the score predictor required the addition of the new NBME tests and remained to be validated.

In this study, we examined the correlation of Step 1 scores with the new MCAT format, question banks, and self-assessment tests; we also updated and validated an existing Step 1 score predictor, and identified the minimum number of tests required as well as an optimal study period to facilitate success in the Step 1 examinations.

Materials & Methods

Data collection and analysis

We posted an anonymous survey on Reddit requesting users who had already taken the USMLE Step 1 examination to submit their scores along with all relevant practice test scores as well as their MCAT score and the dates when the tests were taken. All accrued data were downloaded and compiled into a single Excel sheet. A total of 466 responses were received. Reddit usernames were used to determine duplicity of information; duplicate values were found and deleted. This was followed by deleting responses that only listed the USMLE Step 1 scores but not practice test scores such that a total of 399 scores could be used. However, the number of responses for each test varied based on the number of students using that particular test. Data were then de-identified by removing Reddit usernames and used for statistical analysis.

Statistics

Linear regression analysis was used to determine the correlation between scores on the new MCAT format and Step 1 score as well as between the old MCAT format and Step 1 score received by the student. Similarly, linear regression analysis was again used to determine the correlation between each of the selected practice tests and question banks with the Step 1 score. Multiple regression analysis could not be performed since students differed in the number and type of practice tests and questions banks; therefore, p-values for practice tests or question banks were adjusted using the Holm-Sidak test. One-way analysis of variance (ANOVA) or Student’s t-tests were used to determine significance using GraphPad Prism version 8.03 (GraphPad Software, San Diego, CA) as appropriate. The Shapiro-Wilk test was used to determine normality. A p-value of <0.05 was considered statistically significant.

Step 1 score predictor

A Step 1 score predictor that utilizes performance on practice tests and on question banks to predict the USMLE Step 1 scores has been available on Reddit for the past several years (https://drive.google.com/file/d/1r2ir9uEU58PzKHVfYFaHhZG6mKs_YTNI/view). The calculator utilizes the lines of best fit for each practice test to give an estimated score. The adjusted R2 value of the line of best fit for each practice test is then used to weight the estimated scores used in the calculation. The average of all such weighted estimated scores is used towards predicting the USMLE Step 1 score. In addition to the scores themselves, the date of the practice tests is also included in the calculations such that practice tests that are taken closer to the actual USMLE examination are weighted more heavily than those taken much earlier. However, with the introduction of the new NBME practice tests (NBME Forms 20-24), it was necessary to modify the calculator (https://drive.google.com/file/d/1Ry-BCrt8BT-cVsrXP2Yu6el-KrAeP6rX/view?usp=sharing). The modified calculator was tested using 19 scores that were not part of the original 466 responses.

Results

The positive correlation of MCAT scores with USMLE Step 1 scores

The mean score of survey participants on the new MCAT was 510.1 ± 6.3 (range: 490-526); this score is similar to the average MCAT score of matriculants to United States allopathic medical schools in the year 2017-2018 (510.4 ± 6.6) [21,22]. The mean Step 1 score of survey participants was 246.1 ± 14.2 (range: 202-271); the national average is 231 [22]. The mean score of survey participants on the old MCAT was 31.3 ± 4.0 (range: 490-526). While the old MCAT positively correlated with USMLE Step 1, the new MCAT correlated better with performance on Step 1 (Figure 1).

The association of new NBME CBSSA tests with improved USMLE Step 1 scores

New NBME CBSSA tests (Forms 20-24) were released in Spring 2019 with concurrent removal of practice tests 13, 15, 16, 17 and 19. The contributions of the new NBME tests towards USMLE Step 1 scores have never been assessed. Of students who participated in this survey, those who did not take any of the new NBME practice tests scored 239.8 ± 15.7, and those who took at least one new NBME practice tests scored 247.1 ± 13.7. A two-tailed t-test analysis revealed a t-value of -3.69 [degree of freedom (df) = 397] with a p-value of 0.0003, indicating that students who took at least one of the new NBME practice tests scored better than their counterparts who did not. Interestingly, individuals who took four or all of the new NBME practice tests (mean = 249.6 ± 13.8) scored significantly higher than those who took between one and three examinations (mean = 245.8 ± 13.5) respectively (t-value: -2.48, p: 0.007). A simple regression analysis indicated that there was no significant difference between students taking one or more of the new NBME practice tests (R= 0.023; p: 0.099).

To determine if those students who used the new NBME practice tests also used greater numbers of other practice tests, we divided our cohort into six groups of students who took from zero to all five of the new NBME tests. We then determined the average number of other tests (excluding the new NBME tests) taken by these groups. Those who did not use any of the new NBME tests took an average of 3.448 ± 2.429 other tests (n = 58), those who used one of the new NBME tests took an average of 3.804 ± 1.586 (n = 46), those who used two of the new NBME tests took an average of 3.607 ±- 1.276 tests (n = 89), those who used three of the new NBME tests took an average of 3.659 ± 1.492 tests (n = 85), those who used four of the new NBME tests took an average of 3.489 ± 1.098 tests (n = 45), and those who used all five new NBME tests took an average of 4.750 ± 2.198 tests (n = 76). While there was no statistically significant difference between those who took none of the new NBME tests and those who took between one to four of the new NBME tests, there was a significant difference between those took all five of the new NBME tests and those who took none of the new NBME tests (p: 0.0015). These data suggest that while most students did not avail of other additional practice tests, those who took all five of the new NBME tests were also more likely to utilize as many practice tests as available.

The close match between UWSA2 performance and USMLE Step 1 scores

Among all the practice tests analyzed (Figure 2), scores on the UWSA2 exhibited the highest correlation with USMLE Step 1 scores, with an R2 value of 0.680 (Table 1). The next-best correlation with Step 1 scores was NBME CBSSA Form 16, with an R2 value of 0.660. UWorld QBank ranked third, with an R2 value of 0.656. Since NBME 16 has been discontinued since March 2019, the UWSA2 and QBank now rank at the top. Interestingly, the highest R2 value for any of the newer NBME practice tests (20-24) was only 0.620 even though the number of responses for these tests was far greater compared to NBME Form 16.

Test name Responses, n Coefficient of determination, R2 Holm-Sidak, adj. p-value Average score Slope ± SEM 95% confidence interval of slope
NBME 13 64 0.305 4.454e-006 222.0 0.351 ± 0.067 0.217–0.486
NBME 15 73 0.452 2.164e-010 222.4 0.424 ± 0.055 0.313–0.534
NBME 16 123 0.660 0.000 230.1 0.535 ± 0.035 0.466–0.603
NBME 17 130 0.413 8.882e-016 248.2 0.461 ± 0.047 0.366–0.556
NBME 18 333 0.589 0.000 236.1 0.531 ± 0.024 0.483–0.579
NBME 19 64 0.187 3.549e-004 233.4 0.325 ± 0.086 0.153–0.496
NBME 20 242 0.555 0.000 228.1 0.528 ± 0.031 0.468–0.588
NBME 21 280 0.563 0.000 231.5 0.543 ± 0.029 0.487–0.599
NBME 22 188 0.618 0.000 235.4 0.627 ± 0.036 0.556–0.698
NBME 23 163 0.620 0.000 235.7 0.670 ± 0.041 0.589–0.751
NBME 24 166 0.582 0.000 237.4 0.561 ± 0.037 0.489–0.634
Free 120 351 0.567 0.000 *84.7% 1.589 ± 0.074 1.444–1.735
UWSA 1 360 0.619 0.000 248.1 0.486 ± 0.020 0.446–0.525
UWSA 2 369 0.680 0.000 248.2 0.694 ± 0.025 0.646–0.743
UWorld QBank 383 0.656 0.000 *72.8% 1.191 ± 0.044 1.104–1.277

Additionally, a comparison of the difference between the scores on each practice test with the actual Step 1 scores showed that UWSA2 scores were closest to Step 1 scores (average difference = 6.9 points; Table 2). 

Test  Name Average practice test score Average Step 1 score Average difference* Responses, n
NBME 13 222.0 250.1 28.6 64
NBME 15 222.4 247.3 25.4 73
NBME 16 230.1 248.8 19.1 123
NBME 17 233.9 248.2 17.1 130
NBME 18 236.1 246.9 12.8 333
NBME 19 233.4 249.7 19.5 64
NBME 20 228.1 248.1 20.7 242
NBME 21 231.5 247.1 16.8 280
NBME 22 235.4                 248.7 14.8 188
NBME 23 235.7 248.3 13.8 163
NBME 24 237.4 247.4 11.9 166
UWSA 1 248.1 246.7 10.5 360
UWSA 2 248.2 246.7 6.9 369

To assess the relationship between sample size and the correlation between practice materials and Step 1 scores, a line of best fit correlating the R2 values as well as the “n” for each group was created; the R2 for that line was 0.245, indicating that while sample size did have a slight effect on correlation, it was not the only factor.

A comparison between the performance of students who took UWorld practice tests and students who did not take a single UWorld practice test

Considering that UWSA2 had the highest single practice test correlation with USMLE Step 1 scores, it was important to determine if students who took either UWSA1 or UWSA2 practice tests or both obtained higher scores in the Step 1 examination as compared to those students who did not use UWorld. A two-tailed t-test indicated a significant difference (t-value: -3.056; p: 0.001) between the mean Step 1 scores of those who took at least one UWorld practice test (246.5 ± 13.9) and those who did not take a single UWorld practice test (236.4 ± 17.2). Similarly, a two-tailed t-test comparing those who took only one UWSA test (242.4 ± 13.2) to those taking both UWSA tests (246.9 ± 13.9) revealed a significant difference (t-value: -1.74; p: 0.042), indicating the importance of UWSA tests in maximizing USMLE Step 1 scores.

To determine if those students who used the UWSA tests took greater numbers of other practice tests, we divided our cohort into three groups: students who took zero, one, or both of the UWSA tests. Students who did not take any of the UWorld tests took 1.632 ± 2.006 other additional tests (n=19); students who took one of the UWorld tests took 3.258 ± 2.236 additional tests (n=31), and students who took both of the UWorld tests took 4.880 ± 2.345 additional tests (n=349). The difference between the groups who took none of the UWorld tests and the groups who took at least one of the UWorld tests was statistically significant (p: 0.013); similarly, there was a statistically significant difference between the groups that took none of the UWorld tests and the groups who took both of the UWorld tests (p: 0.0001). Since the difference between those students who took one UWorld test and those who took both UWorld tests was also statistically significant (p: 0.0002), these data suggest that students who took more UWorld practice tests were also more willing to practice using multiple tests.

The optimal number of tests to maximize USMLE Step 1 scores

This study enabled us to determine the optimal number of practice tests for maximizing USMLE Step 1 score. Because the average number of tests taken by participants in this study was 6.4 ± 2.7 tests, we divided the responses into three categories: those whose used between 0-5 tests (n = 139; mean = 242.5 ± 14.0; median = 246), those who used 6-9 practice tests (n = 217; mean = 247.6 ± 13.7; median = 250) and those who used 10-14 tests (n = 43; mean = 249.6 ± 15.7; median = 253). Because the data within each of the groups were not normally distributed (Shapiro-Wilk normality test), non-parametric Kruskal-Wallis ANOVA was used to compare the medians of the groups (p: 0.000). The Mann-Whitney test indicated a significant difference between those taking zero-five tests and those taking six-nine tests (p: 0.006); however, there was no difference between those taking six-nine tests and those taking 10-14 tests (p; 0.158), suggesting that the optimal number of practice tests was between six and nine. Since the average number of tests taken by participants in this study was six, this may have partly accounted for the relatively high mean USMLE Step 1 score of the participants (246.1 ± 14.2) compared to the national average of 231 in 2018 [22].

Prediction of scores based on performance on practice tests

With the responses collected from the initial survey, we updated an existing Step 1 score predictor found on Reddit. This predictor utilized lines of best fit correlating practice test and question bank scores with Step 1 scores, and weighted the outputs by R2 value of each line of best fit as well as by the date taken. Therefore, tests that had a higher correlation with Step 1 score were weighted more heavily than those with lower correlations, and practice tests that were taken closer to actual test dates were weighted more heavily as well. After updating the predictor, 19 responses that were not used in creating lines of best fit for the predictor were used to test its accuracy (Table 3).

Student Predicted score Actual score Difference between predicted and actual scores
1 216.6 211 5.6
2 226.9 227 -0.1
3 243.2 230 13.2
4 240.7 234 6.7
5 239.4 237 2.3
6 241 237 4.0
7 239.4 243 -3.6
8 245.8 247 -1.3
9 239 247 -8.0
10 244.2 248 -3.8
11 252.5 250 2.5
12 249.2 250 -0.8
13 247.6 251 -3.4
14 253.4 254 -0.6
15 252.9 254 -1.1
16 253.6 254 -0.4
17 249.1 256 -6.9
18 258 256 2.0
19 256.1 262 -5.9

The linear regression of predicted Step 1 score outputs from the predictor to actual Step 1 scores showed a high correlation (Figure 3). Residuals were normally distributed.

Discussion

Previous studies have indicated a significant but weak (17%) correlation between performance on the older version of MCAT and performance on USMLE Step examinations [12]. So far, only the University of Minnesota Medical School-Twin Cities has correlated scores on the new MCAT format with USMLE Step 1 scores (n = 220; multiple R = 0.44). This study, which sampled scores from students across the United States rather than a specific school (n = 282), corroborates their findings by finding a small but significant correlation between scores obtained on the new MCAT format and Step 1 performance (21%).

While enrolling in commercial coaching classes does not improve Step 1 performance, the importance of self-assessment practice questions and question banks in improving student understanding of the subject while simultaneously enhancing performance on standardized tests is well-known [23,24]. For example, students who self-assessed with 4,001-6,000 practice questions scored higher on USMLE Step 1 than those who took less than 2,000 questions [19]. Out of 399 usable responses in this study, 390 participants (97.7%) elected to use at least one practice test; 383 participants (96%) used UWorld QBank as a resource. While the number of practice tests varied between participants (mean: six tests; range: 0-14), there was a very clear association between the number of practice tests taken and Step 1 scores, with participants who took between six and nine practice examinations receiving the highest scores.

Arguably, the most fascinating result of this study, however, was the finding that UWSA2 scores might be best correlated with Step 1 scores. Considering that UWSA2 is produced by a company that is not directly involved with the development of Step 1 examinations, it was surprising to note that it more closely matched Step 1 scores as compared to self-assessment tests released by the NBME. While the sample size did have a slight effect on correlation, it was not the only factor. An alternative explanation could be the use of different grading curves on the NBME CBSSA tests as compared to the UWSA tests. It is possible that the UWSA2 grading curve more closely matches the grading curve on Step 1 examinations and, therefore, correlates better. However, correlating the average score of each selected practice test with the R2 value of its line of best fit revealed an R2 value of 0.256, suggesting that additional factors besides the grading curve contribute to the higher predictive value of UWSA2.

Another surprising finding of this study was the efficacy of the predictive model. A previous model used performance on CBSE and UWorld QBank, obtaining a grade of A during preclinical years, and receiving a need-based scholarship to predict Step 1 scores [17]. However, for this model to be viable, answers to all variables needed to be entered; any missing data would significantly hamper its ability to predict Step 1 scores. In contrast, data from our study showed that performance on practice tests are sufficient to predict Step 1 scores accurately. Additionally, the Step 1 score predictor used in our study allowed reporting but did not require the scores of the 14 different NBME CBSSA and UWorld practice assessments, UWorld QBank, and the NBME Free 120 questions. Given the high correlation between predicted and actual Step 1 scores, this score predictor becomes a useful tool to self-assess progress when studying for Step 1.

There were several limitations to this retrospective study. The study required students to volunteer and report their scores, and this may have resulted in a selection bias. Although the mean MCAT score of participants was similar to the national mean of matriculants who would appear for Step 1 examination in 2019, the mean Step 1 score was significantly higher than the national average. This indicated that the cohort of participants was significantly skewed towards higher-scoring students, possibly because students who score higher are more likely to volunteer to report their scores. We were also unaware of other preparatory materials the students may have used that could have a significant effect on their performance. Nevertheless, this study provides further evidence that correlates scores on the new MCAT format with Step 1 scores; It also delineates the contributions of specific self-assessment tests and question banks towards performance on Step 1 examinations and highlights their predictive value.

Conclusions

This study utilized a cohort not restricted to a particular university to correlate scores on the new MCAT format with USMLE Step 1 scores as well as to analyze widely used self-assessment resources currently available for Step 1 preparation. Our results confirm the importance of MCAT not only as a stratifying factor for medical school admissions but also as a significant predictor of Step 1 outcomes. Importantly, data obtained from this study allowed an existing score predictor to be updated and validated. The results of this study will help cost-conscious students and undergraduate medical institutions to select appropriate self-assessment tests for evaluating their preparation for the USMLE Step 1 examination and remove the ambiguous interpretation of practice test scores with perceived progress. Additionally, the updated USMLE Step 1 score predictor will allow students to self-evaluate and gauge their progress in real-time. Given the ever-increasing competition in obtaining residency positions, it is hoped that the results of this research will help prepare and assess the readiness of students prior to taking the examination and thereby help reduce student stress and improve student wellness.

In February 2020, FSMB and NBME announced pass/fail reporting for Step 1 examinations held after January 2022 to decrease the emphasis on USMLE in medical schools. Due to the imminent loss of Step 1 as a screening tool for residency selection, residency directors will need to develop novel methods to select interviewees, such as a standardized video interview, to help bolster a holistic approach to resident selection. However, since Step 1 scores significantly correlate with student performance in medical clerkships, Step 2, and residency, adequate preparation for Step 1 needs to continue for achieving overall success in medical education.


References

  1. Haist SA, Butler AP, Paniagua MA: Testing and evaluation: the present and future of the assessment of medical professionals. Adv Physiol Educ. 2017, 41:149-153. 10.1152/advan.00001.2017
  2. The United States Medical Licensing Examination (USMLE) content outline. (2020). Accessed: January 5, 2020: https://www.usmle.org/pdfs/usmlecontentoutline.pdf.
  3. National Resident Matching Program: results of the 2018 NRMP program director survey. (2018). Accessed: January 5, 2020: https://www.nrmp.org/wp-content/uploads/2018/07/NRMP-2018-Program-Director-Survey-for-WWW.pdf.
  4. Casey PM, Palmer BA, Thompson GB, et al.: Predictors of medical school clerkship performance: a multispecialty longitudinal analysis of standardized examination scores and clinical assessments. BMC Med Educ. 2016, 16:128. Accessed: April 2, 2020: https://bmcmededuc.biomedcentral.com/articles/10.1186/s12909-016-0652-y. 10.1186/s12909-016-0652-y
  5. Kozar RA, Kao LS, Miller CC, Schenarts KD: Preclinical predictors of surgery NBME exam performance. J Surg Res. 2007, 140:204-207. 10.1016/j.jss.2007.01.035
  6. Gauer JL, Jackson JB: The association of USMLE Step 1 and Step 2 CK scores with residency match specialty and location. Med Educ Online. 2017, 22:1358579. Accessed: April 2, 2020: https://www.ncbi.nlm.nih.gov/pubmed/28762297. 10.1080/10872981.2017.1358579
  7. Gauer JL, Jackson JB: The association between United States Medical Licensing Examination scores and clinical performance in medical students. Adv Med Educ Pract. 2019, 10:209-216. Accessed: April 2, 2020: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6497117/. 10.2147/AMEP.S192011
  8. Ogunyemi D, Taylor-Harris D: Factors that correlate with the U.S. Medical Licensure Examination Step-2 scores in a diverse medical student population. J Natl Med Assoc. 2005, 97:1258-1262.
  9. Raman T, Alrabaa RG, Sood A, Maloof P, Benevenia J, Berberian W: Does residency selection criteria predict performance in orthopaedic surgery residency?. Clin Orthop Relat Res. 2016, 474:908-914. 10.1007/s11999-015-4317-7
  10. Association of American Medical Colleges. Using MCAT data in 2020 medical student selection. (2019). Accessed: January 5, 2020: https://www.aamc.org/system/files/c/1/498250-usingmcatdatain2020medstudentselection.pdf.
  11. Didier T, Kreiter CD, Buri R, Solow C: Investigating the utility of a GPA institutional adjustment index. Adv Health Sci Educ Theory Pract. 2006, 11:145-153. 10.1007/s10459-005-0390-0
  12. Gauer JL, Wolff JM, Jackson JB: Do MCAT scores predict USMLE scores? An analysis on 5 years of medical student data. Med Educ Online. 2016, 21:31795. Accessed: April 2, 2020: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5045966/. 10.3402/meo.v21.31795
  13. Saguil A, Dong T, Gingerich RJ, et al.: Does the MCAT predict medical school and PGY-1 performance?. Mil Med. 2015, 180:4-11. 10.7205/MILMED-D-14-00550
  14. Busche K, Elks ML, Hanson JT, et al.: The validity of scores from the new MCAT exam in predicting student performance: results from a multisite study. Acad Med. 2020, 95:387-395. 10.1097/ACM.0000000000002942
  15. Violato C, Gauer JL, Violato EM, Patel D: A study of the validity of the new MCAT exam. Acad Med. 2020, 95:396-400. 10.1097/ACM.0000000000003064
  16. Baños JH, Pepin ME, Van Wagoner N: Class-wide access to a commercial step 1 question bank during preclinical organ-based modules: a pilot project. Acad Med. 2018, 93:486-490. 10.1097/ACM.0000000000001861
  17. Giordano C, Hutchinson D, Peppler R: A predictive model for USMLE Step 1 scores. Cureus. 2016, 8:e769. Accessed: April 2, 2020: https://www.cureus.com/articles/4700-a-predictive-model-for-usmle-step-1-scores. 10.7759/cureus.769
  18. Jackson F, Duane E, Harmon R, Kollar RA, Rainville NM, Smith RM: Resources that improve medical board licensing examination performance. Cureus. 2019, 11:e5927. Accessed: April 2, 2020: https://www.cureus.com/articles/17964-resources-that-improve-medical-board-licensing-examination-performance. 10.7759/cureus.5927
  19. Kumar AD, Shah MK, Maley JH, Evron J, Gyftopoulos A, Miller C: Preparing to take the USMLE Step 1: a survey on medical students' self-reported study habits. Postgrad Med J. 2015, 91:257-261. 10.1136/postgradmedj-2014-133081
  20. Strowd RE, Lambros A: Impacting student anxiety for the USMLE Step 1 through process-oriented preparation. Med Educ Online. 2010, 15:4880. Accessed: April 2, 2020: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2830045/. 10.3402/meo.v15i0.4880
  21. Association of American Medical Colleges: Table A-16: MCAT scores and GPAs for applicants and matriculants to U.S. medical schools, 2017-2018 through 2019-2020. (2019). Accessed: January 5, 2020: https://www.aamc.org › system › files › 2019_FACTS_Table_A-16.
  22. Association of American Medical Colleges: USMLE score interpretation guidelines. (2019). Accessed: January 5, 2020: https://www.usmle.org/pdfs/transcripts/USMLE_Step_Examination_Score_Interpretation_Guidelines.pdf.
  23. Werner LS, Bull BS: The effect of three commercial coaching courses on Step One USMLE performance. Med Educ. 2003, 37:527-531. 10.1046/j.1365-2923.2003.01534.x
  24. Larsen DP, Butler AC, Roediger HL 3rd: Test-enhanced learning in medical education. Med Educ. 2008, 42:959-966. 10.1111/j.1365-2923.2008.03124.x
Original article
peer-reviewed

Correlation of Medical College Admission Test Scores and Self-assessment Materials with the United States Medical Licensing Examination Step 1 Performance


Author Information

Zachary A. Seal

Medical Education and Simulation, University of Texas Health Science Center at San Antonio, San Antonio, USA

Wouter Koek

Psychiatry, University of Texas Health Science Center at San Antonio, San Antonio, USA

Ramaswamy Sharma Corresponding Author

Cell Systems and Anatomy, University of Texas Health Science Center at San Antonio, San Antonio, USA


Ethics Statement and Conflict of Interest Disclosures

Human subjects: Consent was obtained by all participants in this study. University of Texas Health San Antonio issued approval HSC20190517N. This study was considered to be not human research as defined by DHHS regulations 45 CFR 46 and FDA regulations 21 CFR 56 by the Institutional Review Board at the University of Texas Health San Antonio. Animal subjects: All authors have confirmed that this study did not involve animal subjects or tissue. Conflicts of interest: In compliance with the ICMJE uniform disclosure form, all authors declare the following: Payment/services info: All authors have declared that no financial support was received from any organization for the submitted work. Financial relationships: All authors have declared that they have no financial relationships at present or within the previous three years with any organizations that might have an interest in the submitted work. Other relationships: All authors have declared that there are no other relationships or activities that could appear to have influenced the submitted work.


Original article
peer-reviewed

Correlation of Medical College Admission Test Scores and Self-assessment Materials with the United States Medical Licensing Examination Step 1 Performance


Figures etc.

SIQ
7.9
RATED BY 7 READERS
CONTRIBUTE RATING

Scholary Impact Quotient™ (SIQ™) is our unique post-publication peer review rating process. Learn more here.