Information Theory
Lecture Contents
- Fundamentals of Information Theory for Discrete Random Variables
- Information Measures
- Inequalities
- Information Measures for Random Sequences
- Asymptotic Equipartition Property (AEP)
- Fundamentals of Information Theory for Continuous Random Variables
- Source Coding
- Classification of Codes
- Bounds on Codeword Length and Existence of Codes
- Huffman Coding
- Arithmetic Coding
- Communication Channels and Information Capacity
- Discrete Channel Models
- Channel Capacity
- Linear Channel Models
- Capacity of Fundamental Channels
- Channel Coding
- Decoding Rules
- Error Probabilities
- Rate Distortion Theory
- Machine Learning and Biological Information Exchange
- T. M. Cover and J. A. Thomas: Elements of Information Theory, John Wiley & Sons Inc, 2006.
- I. Csiszar and J. Körner: Information Theory, Cambridge University Press, 2011.
- R. W. Yeung: Information Theory and Network Coding, Springer, 2008.
- R. B. Ash: Information Theory, Dover Publications, 1990.
- R. Mathar: Informationstheorie, Teubner Studienbücher, 1996.
- D. J. C. MacKay: Information Theory, Inference and Learning Algorithms, Cambridge University Press, 2003.
- D. P. Bertsekas: Convex Analysis and Optimization, Athena Scientific, 2003.