ABSTRACT
Mathematical theory that is concerned with the statistical regularities (formal structure and disruptive factors) in the transmission and processing of information2 and which can be viewed as a discipline fundamental to various sciences (among them biology, psychology, theoretical linguistics). Numerous terms that play a role in the description of linguistic regularities are tied to knowledge about and definitions of information ( bit, code, data, entropy, communication, redundancy, sign). The development of a theory of a qualitative concept of information is still in its infancy; it belongs to the
mathematical linguistics)
References
Shannon, C.E. and W.Weaver. 1949. The mathematical theory of communication. Urbana, IL.
