Raters' responses to the lexical features in the english L2 writing of instructed intermediate EFL learners

Abstract

This research report presents a study on vocabulary use in the L2 writing performance of a group of students from the program of English Linguistics and Literature at the Universidad de Chile. The data for the study correspond to ten tests used in a previous study (Aranda et al, 2013) and categorized in Top and Bottom groups by four teachers in relation to the quality of their performance. In addition, the study used data from four interviews to the same four teachers in order to know the specific aspects they consider when assessing vocabulary use in L2 writing performance. The tests were analyzed qualitatively in search for lexical diversity and lexical sophistication features that could account for the difference in perceived quality between the two groups. Such features included the Lexical Frequency Profile for each test, the computation of MTLD, the presence of words related to the topic of the tests and the presence of lexical errors. The interviews were transcribed and a list of the most important aspects of assessment of L2 writing according to the teachers was elaborated. The aspects identified include lexical sophistication, lexical diversity, lexical error and topic appropriateness. The results of the tests’ analyses and the interviews were contrasted, looking for the degree of coherence between them. Results show that, even when there is some degree of coherence between the tests’ analyses and what the teachers say they evaluate, lexical error is the most meaningful aspect when comparing Top and Bottom tests. This is so even when teachers considered lexical sophistication as the most important aspect for them when assessing L2 written vocabulary.