ABSTRACT
One of the most common applications of statistics in the social and behavioral science is in testing null hypotheses. For example, a researcher wanting to compare the outcomes of two treatments will usually do so by testing the hypothesis that in the population there is no difference in the outcomes of the two treatments. If this null hypothesis can be rejected, the researcher is likely to conclude that there is a real difference in treatment outcomes. The power of a statistical test is defined as the likelihood that a researcher will be able to reject a specific null hypothesis when it is in fact false. One of the key determinants of power is the degree to which the null hypothesis is false; if treatments in fact have a very small effect, it may be difficult to reject the hypothesis that they have no effect whatsoever. However, effect size is not the only determinant of power. The power of statistical tests is a complex function of the sensitivity of the test, the nature of the treatment effect, and the decision rules used to define statistical significance.
