Objective. To explore the relationship between a multiple mini-interview (MMI) and situational judgment test (SJT) designed to evaluate non-academic constructs.Methods. A 30-question ranked-item SJT was developed to test three constructs also measured by MMIs during the School's admissions process. First-year pharmacy students were invited to complete the SJT, administered via Qualtrics, in Fall 2020. One hundred and four students took the SJT (82.5% response rate) with 97 (77% of possible

more »

... cipants) having MMI scores from the admissions process. Descriptive statistics (mean ± standard deviation), Concordance analysis, Spearman's correlation, Cronbach's alpha, and principal components analysis were used to explore the psychometric properties of the SJT and its relationship to MMI scores.Results. Seventy-four percent of students identified as female (n=72) and 11.3% identified with an underrepresented racial identity (n=11). The average age was 21.8±2.1 years. Students averaged 85.5%±3.1 (out of 100 points) on the SJT and 6.1±1.0 on the MMI (out of 10 points). Principal components analysis indicated that the SJT lacked construct validity and internal reliability. However, reliability of the entire SJT instrument provided support for using the total SJT score for analysis (α=63). Correlations between total SJT and MMI scores were weak (rp<0.29).Conclusion. Results of this study suggest that an SJT may not be a good replacement for the MMI to measure distinct constructs during the admissions process. However, the SJT may provide useful supplemental information during admissions or as part of formative feedback once students are enrolled in a program.