ABSTRACT

Messages from a source, seen as symbols x j from some alphabet, each having probabilities P j associated with a random variable X,are ‘encoded’ into the language of a ‘transmission channel’, a random variable Ywith symbols y k , having probabilities P k , possibly with error. Someone receiving the symbol y k then retranslates it (without error) into some x k , which may or may not be the same as the x j that was sent.