Are your admissions assessments helping you identify the competencies that matter most for the success of future healthcare professionals?
Future healthcare professionals need more than academic knowledge to succeed. They also need strong interpersonal skills, sound judgment, and professionalism. But are your admissions assessments designed to evaluate these different competencies from the get-go? That’s where competency-aligned admissions come in.
A competency-aligned admissions approach starts by identifying the personal, professional, and academic attributes that matter most to your program. From there, programs can select admissions assessments that are designed to evaluate those specific competencies.
After all, admissions assessments aren’t one-size-fits-all solutions. An assessment designed to evaluate academic knowledge shouldn’t necessarily be expected to predict professional performance, and vice versa.
New research reinforces the importance of this distinction and highlights the value of Casper as part of a competency-aligned admissions approach.
A newly published paper, Do competency-aligned admissions assessments predict medical school awards? A validity argument using Kane’s framework reveals that academic admissions tools (i.e., MCAT) only predict students’ academic performance during training, while tools designed to evaluate personal and professional competencies predict professional performance.
A Closer Look at the Study
The peer-reviewed study, which was published in BMC Medical Education, looked at 644 medical school graduates across three cohorts at a single medical school, examining whether the selected four admissions tools (listed below) predicted later Academic, Service, and Clinical Awards:
- Grade point average (GPA)
- Medical College Admission Test (MCAT)
- Casper, Acuity Insights’ open-response situational judgment test (SJT)
- A locally developed multiple mini interview (MMI)
By examining how these different assessments related to later awards, the researchers explored an important question: Do admissions assessments provide meaningful insight into the outcomes they are designed to evaluate?
The study was conducted by:
- Dr. Fern R. Juster, MD, former Senior Associate Dean and Associate Professor of clinical pediatrics at the New York Medical College School of Medicine.
- Dr. Kristina H. Petersen, PhD, Assistant Dean of Student Success & Access and Associate Professor of Biochemistry & Molecular Biophysics at Washington University in St. Louis School of Medicine.
- Dr. Kelly L. Dore, PhD, Founder & VP of Science and Innovation at Acuity Insights; Adjunct Professor in the Department of Medicine, McMaster University.
- Dr. Alexander MacIntosh, PhD, Research Scientist & Senior Manager, Research at Acuity Insights
- Dr. Muhammad Zafar Iqbal, PhD, Senior Research Scientist at Acuity Insights & Full Professor at The University of Lahore
What Did the Study Uncover?
The findings support the value of aligning admissions assessments with the competencies and outcomes programs care about.
Academic assessments were associated with academic recognition
Higher MCAT scores were associated with Academic Awards, which recognize academic achievement and technical knowledge. Higher MCAT scores were not associated with Service or Clinical awards.
This finding reinforces the value of academic assessments for evaluating academic competencies, while highlighting why they shouldn’t be expected to capture all of the essential professional qualities that contribute to success in healthcare.
Casper and MMIs were associated with professional recognition
Both Casper and MMIs, which assess interpersonal and professional competencies, were associated with Service Awards.
These awards recognize contributions and qualities related to professional performance, providing a different perspective on student achievement than academic recognition alone.
Among medical students scoring in the top 20% on Casper, 31% received a Service Award, compared with an overall award rate of 22% in the study cohort.
This finding provides evidence that Casper scores can offer meaningful insight into professional competencies that may not be captured by traditional academic measures.
Casper was the only admissions measure significantly associated with Clinical Awards
Perhaps most notably, Casper was the only admissions assessment in the study that showed a statistically significant association with Clinical Awards.
This finding is especially relevant for healthcare programs seeking to identify applicants who demonstrate the interpersonal and professional competencies important to clinical practice.
While these findings come from a single medical school and do not establish that Casper scores will predict every professional or clinical outcome, they provide meaningful evidence supporting Casper’s role within a broader competency-aligned admissions process.
What Does This Mean For Competency-Aligned Admissions?
The central takeaway from this research isn’t that one admissions assessment should replace another. It’s that different assessments serve different purposes, and each can contribute valuable information when aligned with the competencies a program wants to evaluate at admissions and later on in medical school.
Academic measures such as GPA and MCAT provide insight into applicants’ academic preparation and knowledge. Assessments like Casper add another important dimension by evaluating how applicants think, reason, and exercise judgment in situations involving interpersonal and professional challenges.
Together, these complementary measures can help admissions teams build a more complete understanding of applicants across the competencies that matter to their programs.
The study also strengthens the evidence supporting Casper as a valuable component of competency-aligned admissions. Its associations with Service and Clinical Awards suggest that it can provide information relevant to professional and clinical recognition that academic assessments alone may not capture.
Build an Admissions Approach Around the Competencies That Matter
Selecting future healthcare professionals requires evaluating more than what applicants know today. It also means considering the personal and professional competencies they’ll need throughout their education and future practice.
A competency-aligned admissions approach helps programs make those priorities explicit and select assessments with a clear purpose.
The goal isn’t to find one assessment that predicts everything. It’s to bring together assessments that measure different, relevant competencies.
This latest research provides further support for that approach and highlights how Casper can contribute valuable insight into applicants’ social intelligence and professionalism alongside traditional academic measures.
Explore how Casper can support your program’s competency-aligned admissions approach.




