ABSTRACT

Chapter 4 deals with many design issues that need to be taken into consideration when planning a study using judgment tasks. Each specific design feature (e.g., number and kinds of appropriate sentences [grammatical/ungrammatical, fillers], instructions, ratings and scales, confidence and source ratings, error correction, modality, time limits, participants, sentences in context) is followed by recommendations based on best practices and common use. Other issues that are relevant to the design of a study are also considered (e.g., age, linguistic complexity, proficiency level). The chapter concludes with a discussion of the importance of data sharing.