Back to search results

Information Theory


Provider
coursera

Price
Free

School
The Chinese University of Hong Kong

Type
University

Instructor
Raymond W. Yeung

Category
Technology

Duration
18 weeks

Format
Video

Language
English

Description
The lectures are based on the first 11 chapters of Prof. Raymond Yeung’s textbook entitled Information Theory and Network Coding (Springer 2008). Chapter 1 The Science of Information  Chapter 2 Information Measures  Chapter 3 The I-Measure  Chapter 4 Zero-Error Data Compression  Chapter 5 Weak Typicality  Chapter 6 Strong Typicality  Chapter 7 Discrete Memoryless Channels  Chapter 8 Rate-Distortion Theory  Chapter 9 The Blahut-Arimoto Algorithms  Chapter 10 Differential Entropy  Chapter 11 Continuous-Valued Channels This book and its predecessor, A First Course in Information Theory (Kluwer 2002, essentially the first edition of the 2008 book), have been adopted by over 60 universities around the world as either a textbook or reference text. The electronic version of the 2008 book can be downloaded for free (with institutional subscription). At the completion of this course, the student should be able to: Demonstrate knowledge and understanding of the fundamentals of information theory. Appreciate the notion of fundamental limits in communication systems and more generally all systems. Develop deeper understanding of communication systems. Apply the concepts of information theory to various disciplines in information science.