Live vs. Video Review

The recent pandemic created a major transition of healthcare services and education from live to virtual platforms; however, there is little guidance on potential differences between live and virtual formats for assessing technical skills. We conducted a systematic literature review searching PubMed, OVID, CINAHL, APA PsychInfo, and Web of Science to identify articles published between 1995 and 2022 focused on comparisons between live and video formats for assessing technical skills in healthcare. Initially, 2,040 articles were identified; after screening, 14 articles remained for data extraction. Four articles demonstrated higher agreement among raters for live format, one demonstrated higher agreement for video format, one article had mixed results, and eight reported no differences. We published the overall findings along with some human factors considerations, including standardization of technical requirements to bridge the gap between live and video assessments found in the literature.

Pacailler, M., Ashdown, A., Powers, S., Ball, R., Perry, K., & Scerbo, M. W. (2023). Live vs. Video Skill Assessments in Healthcare: Are the formats comparable? In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 67(1), 2323-2328.