The Edge of Expertise: Test Writes Think Aloud

Salisbury, Katy (2016) The Edge of Expertise: Test Writes Think Aloud. In: ICERI2016 Proceedings: 9th International Conference of Education, Research and Innovation. IATED Academy, Valencia, Spain, pp. 6089-6097. ISBN 9788461758951

SALISBURY2016EDG.pdf - Published Version

Download (218kB) | Preview


What does it mean to be an expert within a given field? This paper gives an overview of a small-scale research study which explores this question through the prism of one very specific domain – listening test item writing in TESOL (Teaching English to Speakers of Other Languages). Considerable attention has been given by different researchers to outcomes - the ESOL tests themselves - but very little consideration has been given to process: how the tests are produced by item writers. This research uses frameworks frequently found in expertise studies (see, for example, Ericsson et al. 2006) and concurrent-verbalisation (think-aloud) data-gathering techniques (for example, Bowles, 2010) to illuminate processes involved in listening test item writing. It compares the way small groups of novice and experienced test writers undertake the same item-writing task. The findings indicate that, although expertise in test writing is highly individualised, a number of identifiable strategies and practices are associated with expert outcomes. The paper will summarize the ways in which the insights from this study have the potential to inform ESOL test-writer training and it will also make an introductory case for using concurrent verbalization to shed light on the cognitive operations used by experts in many different domains.

Item Type: Book Section
Additional Information: ISSN 2340-1095
Keywords: Tesol test writing, test-writer training, think-aloud, verbal protocol analysis (VPA)
Divisions: ?? UniversityCollegePlymouthMarkJohn ??
Depositing User: Mrs Wendy Evans
Date Deposited: 20 Jan 2017 15:28
Last Modified: 27 Jan 2020 15:25

Actions (login required)

Edit Item Edit Item