ABSTRACT

Minimum Message Length (MML) is a technique for measuring the complexity of a rule or set of rules, that is increasing in the complexity of both the data and the rule. Selecting the MML rule is, essentially, an implementation of Ockham's Rule. In this case, the complexity of an item is measured as the negative log (base 2) of its probability. It is proportional to the likelihood function.