ABSTRACT

The range of potential randomization tests is limited only by the ingenuity of researchers in designing new randomization procedures. In principle, a valid randomization test can be developed for application to data from any design containing an element of random assignment. Of course, someone has to develop the test. Fortunately, there is probably a relatively small number of core randomization designs, each with possibilities for extension and modification. We have tried to provide a representative sample of designs, along with Minitab, Excel, and SPSS macros, for carrying out randomization tests on data derived from them. In this final chapter we aim to help researchers who are interested in writing macros to match their own random assignment procedures or others that they see described in the literature. We mentioned in chapters 4 and 10 that we decided to use random sampling algorithms for all of our macros, rather than exhaustive generation of all possible data arrangements, to maintain consistency and to permit trade-off between time costs and power. Another gain is that algorithms based on exhaustive data arrangements tend to be highly specific, whereas those based on random sampling from the possible arrangements tend to be somewhat more general and therefore less in need of modification. This is important because modification of existing macros turns out to be problematic for all but the most trivial changes, such as number of arrangements to be randomly sampled.