The effect of mode of response on a semi-direct test of oral proficiency

Kiddle, Thom and Kormos, Judit (2011) The effect of mode of response on a semi-direct test of oral proficiency. Language Assessment Quarterly, 8 (4). pp. 342-360. ISSN 1543-4303

PDF
language_testing_article_preprint.pdf - Submitted Version
Download (430kB)

Abstract

This article reports on a study conducted with 42 participants from a Chilean university, which aimed to determine the effect of mode of response on test performance and test-taker perception of test features by comparing a semidirect online version and a direct face-to-face version of a speaking test. Candidate performances on both test versions were double-marked and analysed using both classical test theory and many-facet Rasch measurement. To gain an insight into students’ perceptions of the two modes of delivery, we also asked candidates to complete a questionnaire after sitting each version. The many-facet Rash analysis showed no significant difference in the difficulty of the two versions of test. Nonetheless, there was a significant preference among candidates for the face-to-face version across a number of different features of the test.