ABSTRACT

Advancing Natural Language Processing in Educational Assessment examines the use of natural language technology in educational testing, measurement, and assessment. Recent developments in natural language processing (NLP) have enabled large-scale educational applications, though scholars and professionals may lack a shared understanding of the strengths and limitations of NLP in assessment as well as the challenges that testing organizations face in implementation. This first-of-its-kind book provides evidence-based practices for the use of NLP-based approaches to automated text and speech scoring, language proficiency assessment, technology-assisted item generation, gamification, learner feedback, and beyond. Spanning historical context, validity and fairness issues, emerging technologies, and implications for feedback and personalization, these chapters represent the most robust treatment yet about NLP for education measurement researchers, psychometricians, testing professionals, and policymakers.

The Open Access version of this book, available at www.taylorfrancis.com, has been made available under a Creative Commons Attribution-NonCommercial-No Derivatives 4.0 license.

part I|73 pages

Automated Scoring

Title
Size: 1.08 MB

chapter 3|27 pages

Speech Analysis in Assessment

Title
Size: 2.88 MB

chapter 4|16 pages

Assessment of Clinical Skills

Title
A Case Study in Constructing an NLP-Based Scoring System for Patient Notes
Size: 1.27 MB

part II|49 pages

Item Development

Title

chapter 6|17 pages

Training Optimus Prime, M.D.

Title
A Case Study of Automated Item Generation Using Artificial Intelligence – From Fine-Tuned GPT2 to GPT3 and Beyond
Size: 1.83 MB

chapter 7|17 pages

Computational Psychometrics for Digital-First Assessments

Title
A Blend of ML and Psychometrics for Item Generation and Scoring
Size: 1.91 MB

part III|40 pages

Validity and Fairness

Title
Size: 0.94 MB

part IV|70 pages

Emerging Technologies

Title

chapter 11|17 pages

Stealth Literacy Assessment

Title
Leveraging Games and NLP in iSTART
Size: 1.68 MB

chapter 12|17 pages

Measuring Scientific Understanding Across International Samples

Title
The Promise of Machine Translation and NLP-Based Machine Learning Technologies
Size: 1.22 MB