ABSTRACT

Chapter 11, “Using Experiments to Evaluate Programs” addresses the important issue of when formal experiments are the appropriate choice for a given evaluation and what elements need to be addressed when planning an experiment. Common objections to conducting experiments are noted, especially given the cost in additional time and money, and important benefits are noted that justify those additional costs. Important considerations that evaluators should take seriously both in conducting experiments and in interpreting the results are explained. Appropriate statistical analyses for common experimental designs are explained, and substantial additional resources are provided online to assist with conducting those analyses. The chapter concludes with a case study illustrating both the challenge and the value of experiments in evaluations.