Entropy and mutual information concepts, Markov chains and entropy rate. Shannon�s lossless source coding, channel capacity, white and colored Gaussian channels, rate distortion theory with applications to scalar and vector quantizer design. Multi-user information theory and applications.