In this chapter we provide a brief overview of the statistical methods that we shall use in the rest of the book. In general, we have a data set x and a set of alternative probability models for describing the data. Our aim is to choose between them or average over them, to describe, compare and predict, based on x. For any model M(θ), with d-dimensional parameter vector θ, we form the likelihood L(θ;x).