ABSTRACT

The mutual information between two random variables X and Y indicates the information explained by X in Y (resp. by Y in X ):

I (X ,Y ) = H (X ) + H (Y ) − H (X ,Y ) or I (X ,Y ) = H (X ) − H (X |Y ) = H (Y ) − H (Y |X ) .