Using video-based situational judgment tests for teacher selection:: A quasi-experiment exploring the relations between test format, subgroup differences, and applicant reactions

Lisa Bardach; Jade Rushby; Lisa Kim; Robert Mark Klassen

doi:10.1080/1359432X.2020.1736619

Using video-based situational judgment tests for teacher selection: A quasi-experiment exploring the relations between test format, subgroup differences, and applicant reactions

Lisa Bardach, Jade Rushby, Lisa Kim, Robert Mark Klassen

Education

Research output: Contribution to journal › Article › peer-review

Abstract

The question whether video-based situational judgment test (SJT) formats provide benefits over ‘traditional’ text-based SJTs has not yet been addressed in research on teacher selection. Focusing on three SJT conditions - two video-based conditions (with and without text), and a text-based condition - we investigated mean differences in applicant reactions and SJT scores, subgroup differences (ethnicity and gender), and relations between SJT scores and applicant reactions. Using a quasi-experimental design, 290 prospective teachers (56.6 % female) were randomly assigned to one of the three SJT conditions. SJT scores did not significantly differ between conditions, but both video-based formats were perceived as more engaging than the text-based format. Results from a multigroup path model indicated that there were gender effects for the text-based condition (females outperforming males), but not for the two video-based conditions. However, ethnicity bias (members from majority groups outperforming members from minority groups) occurred in all conditions. Differentiated patterns of relations were found between applicant reactions and SJT performance, with test anxiety significantly predicting SJT performance in the video with text condition and engagement significantly predicting SJT performance in the video without text condition. Implications for future research and teacher selection practice are discussed.

Original language	English
Number of pages	14
Journal	European Journal of Work and Organizational Psychology
DOIs	https://doi.org/10.1080/1359432X.2020.1736619
Publication status	Published - 12 Mar 2020

Bibliographical note

Access to Document

10.1080/1359432X.2020.1736619

Using video and text based situational judgement tests for teacher selection a quasi experiment exploring the relations between test format subgroup
© 2020 The Author(s).
Final published version, 1.6 MBLicence: CC BY-NC-ND

Cite this

@article{48df80de219041fa8f3dc6e88c0c042e,

title = "Using video-based situational judgment tests for teacher selection:: A quasi-experiment exploring the relations between test format, subgroup differences, and applicant reactions",

abstract = "The question whether video-based situational judgment test (SJT) formats provide benefits over {\textquoteleft}traditional{\textquoteright} text-based SJTs has not yet been addressed in research on teacher selection. Focusing on three SJT conditions - two video-based conditions (with and without text), and a text-based condition - we investigated mean differences in applicant reactions and SJT scores, subgroup differences (ethnicity and gender), and relations between SJT scores and applicant reactions. Using a quasi-experimental design, 290 prospective teachers (56.6 % female) were randomly assigned to one of the three SJT conditions. SJT scores did not significantly differ between conditions, but both video-based formats were perceived as more engaging than the text-based format. Results from a multigroup path model indicated that there were gender effects for the text-based condition (females outperforming males), but not for the two video-based conditions. However, ethnicity bias (members from majority groups outperforming members from minority groups) occurred in all conditions. Differentiated patterns of relations were found between applicant reactions and SJT performance, with test anxiety significantly predicting SJT performance in the video with text condition and engagement significantly predicting SJT performance in the video without text condition. Implications for future research and teacher selection practice are discussed.",

author = "Lisa Bardach and Jade Rushby and Lisa Kim and Klassen, {Robert Mark}",

note = "{\textcopyright} 2020 The Author(s).",

year = "2020",

month = mar,

day = "12",

doi = "10.1080/1359432X.2020.1736619",

language = "English",

journal = "European Journal of Work and Organizational Psychology",

issn = "1359-432X",

publisher = "Taylor & Francis",

}

TY - JOUR

T1 - Using video-based situational judgment tests for teacher selection:

T2 - A quasi-experiment exploring the relations between test format, subgroup differences, and applicant reactions

AU - Bardach, Lisa

AU - Rushby, Jade

AU - Kim, Lisa

AU - Klassen, Robert Mark

PY - 2020/3/12

Y1 - 2020/3/12

N2 - The question whether video-based situational judgment test (SJT) formats provide benefits over ‘traditional’ text-based SJTs has not yet been addressed in research on teacher selection. Focusing on three SJT conditions - two video-based conditions (with and without text), and a text-based condition - we investigated mean differences in applicant reactions and SJT scores, subgroup differences (ethnicity and gender), and relations between SJT scores and applicant reactions. Using a quasi-experimental design, 290 prospective teachers (56.6 % female) were randomly assigned to one of the three SJT conditions. SJT scores did not significantly differ between conditions, but both video-based formats were perceived as more engaging than the text-based format. Results from a multigroup path model indicated that there were gender effects for the text-based condition (females outperforming males), but not for the two video-based conditions. However, ethnicity bias (members from majority groups outperforming members from minority groups) occurred in all conditions. Differentiated patterns of relations were found between applicant reactions and SJT performance, with test anxiety significantly predicting SJT performance in the video with text condition and engagement significantly predicting SJT performance in the video without text condition. Implications for future research and teacher selection practice are discussed.

AB - The question whether video-based situational judgment test (SJT) formats provide benefits over ‘traditional’ text-based SJTs has not yet been addressed in research on teacher selection. Focusing on three SJT conditions - two video-based conditions (with and without text), and a text-based condition - we investigated mean differences in applicant reactions and SJT scores, subgroup differences (ethnicity and gender), and relations between SJT scores and applicant reactions. Using a quasi-experimental design, 290 prospective teachers (56.6 % female) were randomly assigned to one of the three SJT conditions. SJT scores did not significantly differ between conditions, but both video-based formats were perceived as more engaging than the text-based format. Results from a multigroup path model indicated that there were gender effects for the text-based condition (females outperforming males), but not for the two video-based conditions. However, ethnicity bias (members from majority groups outperforming members from minority groups) occurred in all conditions. Differentiated patterns of relations were found between applicant reactions and SJT performance, with test anxiety significantly predicting SJT performance in the video with text condition and engagement significantly predicting SJT performance in the video without text condition. Implications for future research and teacher selection practice are discussed.

U2 - 10.1080/1359432X.2020.1736619

DO - 10.1080/1359432X.2020.1736619

M3 - Article

SN - 1359-432X

JO - European Journal of Work and Organizational Psychology

JF - European Journal of Work and Organizational Psychology

ER -