ABSTRACT

Ralph Hartley, a pioneer of Information Theory, declared, “Information is a very elastic term” (Hartley, 1928), and although Information Theory is rooted in probabilities, a statistician observed, “The key word in Statistics is information…. But, what is information? No other concept in statistics is more elusive in its meaning and less amenable to a generally agreed definition” (Basu, 1975).