ABSTRACT

Fundamental Considerations in Technology Mediated Language Assessment aims to address issues such as how the forced integration of technology into second language assessment has shaped our understanding of key traditional concepts like validity, reliability, washback, authenticity, ethics, fairness, test security, and more.

Although computer-assisted language testing has been around for more than two decades in the context of high-stakes proficiency testing, much of language testing worldwide has shifted to “at-home” mode, and relies heavily on the mediation of digital technology, making its widespread application in classroom settings in response to the COVID-19 outbreak unprecedented. Integration of technology into language assessment has brought with it countless affordances and at the same time challenges, both theoretically and practically. One major theoretical consideration requiring attention is the way technology has contributed to a reconceptualization of major assessment concepts/constructs. There is very limited literature available on the theoretical underpinnings of technology mediated language assessment. This book aims to fill this gap.

This book will appeal to academic specialists, practitioners, or professionals in the field of language assessment, advanced and/or graduate students, and a range of scholars or professionals in disciplines like educational technology, applied linguistics, and teaching English to speakers of other languages (TESOL).

chapter 1|14 pages

Technology mediated language assessment

Key considerations

part I|82 pages

Validity concerns in technology mediated language assessment

chapter 4|15 pages

Balancing construct coverage and efficiency

Test design, security, and validation considerations for a remote-proctored online language test

chapter 5|15 pages

From pen-and-paper trials to computer-based test

Impact on validity

chapter 6|18 pages

Two testing environments and their impact on test equity and comparability of the results

Insights from a national evaluation of learning outcomes

part II|54 pages

Reliability issues and machine scoring

chapter 8|20 pages

Validating an AI-driven scoring system

The Model Card approach

chapter 9|16 pages

Web-based testing and automated scoring

Construct conceptualization and improving reliability

part III|50 pages

Impact, security, and ethical considerations

part IV|72 pages

Options and issues in technology mediated classroom assessment