ABSTRACT

This book examines test validity in the behavioral, social, and educational sciences by exploring three fundamental problems: measurement, causation and meaning. Psychometric and philosophical perspectives receive attention along with unresolved issues. The authors explore how measurement is conceived from both the classical and modern perspectives. The importance of understanding the underlying concepts as well as the practical challenges of test construction and use receive emphasis throughout. The book summarizes the current state of the test validity theory field. Necessary background on test theory and statistics is presented as a conceptual overview where needed.

Each chapter begins with an overview of key material reviewed in previous chapters, concludes with a list of suggested readings, and features boxes with examples that connect theory to practice. These examples reflect actual situations that occurred in psychology, education, and other disciplines in the US and around the globe, bringing theory to life. Critical thinking questions related to the boxed material engage and challenge readers. A few examples include:

What is the difference between intelligence and IQ?

Can people disagree on issues of value but agree on issues of test validity?

Is it possible to ask the same question in two different languages?

The first part of the book contrasts theories of measurement as applied to the validity of behavioral science measures.The next part considers causal theories of measurement in relation to alternatives such as behavior domain sampling, and then unpacks the causal approach in terms of alternative theories of causation.The final section explores the meaning and interpretation of test scores as it applies to test validity. Each set of chapters opens with a review of the key theories and literature and concludes with a review of related open questions in test validity theory. 

Researchers, practitioners and policy makers interested in test validity or developing tests appreciate the book's cutting edge review of test validity. The book also serves as a supplement in graduate or advanced undergraduate courses on test validity, psychometrics, testing or measurement taught in psychology, education, sociology, social work, political science, business, criminal justice and other fields. The book does not assume a background in measurement.

chapter 1|18 pages

Introduction

Surveying the Field of Test Validity Theory

chapter 2|25 pages

Philosophical Theories of Measurement

chapter 3|22 pages

Psychometric Models

chapter 5|24 pages

Test Scores as Samples

Behavior Domain Theory

chapter 6|32 pages

Causality in Measurement

chapter 8|23 pages

Problems in Causation and Validity

Formative Measurement, Networks, and Individual Differences

chapter 9|25 pages

Interpreting Test Responses

Validity, Values, and Evaluation

chapter 10|26 pages

A Model of Test Score Interpretation

chapter 11|26 pages

Open Questions About Test Score Meaning

chapter 12|21 pages

An Integrative View of Test Validity

chapter 13|23 pages

Epilogue as Dialog

The Future of Test Validity Theory