ABSTRACT

Winner of the 2017 AERA Division D Significant Contribution to Educational Measurement and Research Methodology Award!
Technological and statistical advances, along with a strong interest in gathering more information about the state of our educational systems, have made it possible to assess more students, in more countries, more often, and in more subject domains. The Handbook of International Large-Scale Assessment: Background, Technical Issues, and Methods of Data Analysis brings together recognized scholars in the field of ILSA, behavioral statistics, and policy to develop a detailed guide that goes beyond database user manuals.
After highlighting the importance of ILSA data to policy and research, the book reviews methodological aspects and features of the studies based on operational considerations, analytics, and reporting. The book then describes methods of interest to advanced graduate students, researchers, and policy analysts who have a good grounding in quantitative methods, but who are not necessarily quantitative methodologists. In addition, it provides a detailed exposition of the technical details behind these assessments, including the test design, the sampling framework, and estimation methods, with a focus on how these issues impact analysis choices.

part |2 pages

Section I: Policy and Research Relevance of International Large-Scale Assessment Data

chapter 1|8 pages

A Brief Introduction to Modern International Large-Scale Assessment

ByDavid Rutkowski, Leslie Rutkowski, and Matthias von Davier

chapter 2|26 pages

International Large-Scale Assessments: From Research to Policy

ByHans Wagemaker

chapter 3|36 pages

The Impact of International Studies of Academic Achievement on Policy and Research

ByStephen P. Heyneman, Bommi Lee

part |2 pages

Section II: Analytic Processes and Technical Issues Around International Large-Scale Assessment Data

chapter 4|22 pages

Assessment Design for International Large-Scale Assessments

ByLeslie Rutkowski, Eugene Gonzalez, Matthias von Davier, and Yan Zhou

chapter 5|20 pages

Modeling Country-Specic Differential Item Functioning

ByCees Glas, Khurrem Jehangir

chapter 7|20 pages

Analytics in International Large-Scale Assessments: Item Response Theory and Population Models

ByMatthias von Davier and Sandip Sinharay

chapter 8|28 pages

Imputing Prociency Data under Planned Missingness in Population Models

ByMatthias von Davier

chapter 9|26 pages

Population Model Size, Bias, and Variance in Educational Survey Assessments

ByAndreas Oranje, Lei Ye

chapter 10|30 pages

Linking Scales in International Large-Scale Assessments

ByJohn Mazzeo and Matthias von Davier

chapter 11|18 pages

Design Considerations for the Program for International Student Assessment

ByJonathan P. Weeks, Matthias von Davier, and Kentaro Yamamoto

chapter 12|10 pages

Innovative Questionnaire Assessment Methods to Increase Cross-Country Comparability

ByPatrick C. Kyllonen, Jonas P. Bertling

chapter 13|12 pages

Relationship between Computer Use and Educational Achievement

ByMartin Senkbeil, Jörg Wittwer

chapter 14|18 pages

Context Questionnaire Scales in TIMSS and PIRLS 2011

ByMichael O. Martin, Ina V. S. Mullis, Alka Arora, Corinna Preuschoff

chapter 16|16 pages

Contextual Indicators in Adult Literacy Studies: The Case of PIAAC

ByJim Allen, Rolf van der Velden

part |2 pages

Section III: Advanced Analytic Methods for Analyzing International Large-Scale Assessment Data

chapter 18|36 pages

Multilevel Analysis of Assessment Data

ByJee-Seon Kim, Carolyn J. Anderson, Bryan Keller

chapter 19|26 pages

Using Structural Equation Models to Analyze ILSA Data

ByLeslie Rutkowski, Yan Zhou

chapter 20|30 pages

Efcient Handling of Predictors and Outcomes Having Missing Values

ByYongyun Shin

chapter 21|40 pages

Multilevel Modeling of Categorical Response Variables

ByCarolyn J. Anderson, Jee-Seon Kim, Bryan Keller

chapter 22|26 pages

Causal Inference and Comparative Analysis with Large-Scale Assessment Data

ByJoseph P. Robinson

chapter 23|36 pages

Analyzing International Large-Scale Assessment Data within a Bayesian Framework

ByDavid Kaplan, Soojin Park

chapter 24|26 pages

A General Psychometric Approach for Educational Survey Assessments: Flexible Statistical Models and Efcient Estimation Methods

ByFrank Rijmen, Minjeong Jeon, Matthias von Davier, and Sophia Rabe-Hesketh