ABSTRACT

Advancing Natural Language Processing in Educational Assessment examines the use of natural language technology in educational testing, measurement, and assessment. Recent developments in natural language processing (NLP) have enabled large-scale educational applications, though scholars and professionals may lack a shared understanding of the strengths and limitations of NLP in assessment as well as the challenges that testing organizations face in implementation. This first-of-its-kind book provides evidence-based practices for the use of NLP-based approaches to automated text and speech scoring, language proficiency assessment, technology-assisted item generation, gamification, learner feedback, and beyond. Spanning historical context, validity and fairness issues, emerging technologies, and implications for feedback and personalization, these chapters represent the most robust treatment yet about NLP for education measurement researchers, psychometricians, testing professionals, and policymakers.

The Open Access version of this book, available at www.taylorfrancis.com, has been made available under a Creative Commons Attribution-NonCommercial-No Derivatives 4.0 license.

part I|73 pages

Automated Scoring

Size: 2.88 MB

chapter 4|16 pages

Assessment of Clinical Skills

A Case Study in Constructing an NLP-Based Scoring System for Patient Notes
Size: 1.27 MB

part II|49 pages

Item Development

chapter 6|17 pages

Training Optimus Prime, M.D.

A Case Study of Automated Item Generation Using Artificial Intelligence – From Fine-Tuned GPT2 to GPT3 and Beyond
Size: 1.83 MB

chapter 7|17 pages

Computational Psychometrics for Digital-First Assessments

A Blend of ML and Psychometrics for Item Generation and Scoring
Size: 1.91 MB

part III|40 pages

Validity and Fairness

Size: 0.94 MB

part IV|70 pages

Emerging Technologies

chapter 11|17 pages

Stealth Literacy Assessment

Leveraging Games and NLP in iSTART
Size: 1.68 MB

chapter 12|17 pages

Measuring Scientific Understanding Across International Samples

The Promise of Machine Translation and NLP-Based Machine Learning Technologies
Size: 1.22 MB