# E2 201 : Information Theory

## August 2011

### Instructor

### Lecture Hours

Mondays and Wednesdays : 8:30 - 10:00 AM

Fridays : 8:30 - 10:00 AM (Homework discussion sessions)

### Location

### Teaching Assistants

- Nidhin Koshy Vaidhiyan

- Akhil P. T.

### Course syllabus

Entropy, mutual information, source coding, hypothesis testing, channel capacity, channel coding theorems, differential entropy, Gaussian channel, Kolmogorov complexity, rate-distortion theory, brief overview of network information theory.

### Course Grade

- 20/100 : Quizzes on homeworks (fortnightly, Fridays 8:30 - 9:00 AM, followed by a discussion)

- 30/100 : Mid-term (1.5 hours) Friday 30 September 2011, 8:30 - 10:00 AM

- 50/100 : Final (3 hours) Thursday 01 December 2011, 9:00 AM - 12:00 noon

### Homeworks

Fortnightly homeworks.

- Problem Set 1 Discussion on Friday 19 August 2011, Quiz on Friday 26 August 2011
- Problem Set 2 Discussion on Friday 09 September 2011, Quiz on Friday 16 September 2011
- Problem Set 3 Discussion on Monday 26 September 2011, Mid-term on Friday 30 September 2011
- Problem Set 4 Discussion on Wednesday 28 September 2011, Mid-term on Friday 30 September 2011
- Discussion of mid-term examination questions on Monday 03 October 2011
- Problem Set 5 Discussion on Friday 14 October 2011, Quiz on Friday 21 October 2011
- Problem Set 6 Discussion on Friday 28 October 2011, Quiz on Friday 04 November 2011
- Problem Set 7 Discussion on Friday 11 November 2011, Quiz on Friday 18 November 2011
- Problem Set 8 Discussion on Friday 18 November 2011
- Problem Set 9 Discussion on Friday 25 November 2011

### Reference Texts

- Cover, T.M., and Thomas J.A., Elements of Information Theory, 2nd Edition, John Wiley and Sons, 2006.

An affordable older edition is available from Tata Book House, IISc, with 20% discount for IISc students.
- Parthasarathy, K.R., Coding Theorems of Classical and Quantum Information Theory, TRIM no. 45, Hindustan Book Agency, 2007.

Available at an affordable price at Tata Book House, IISc, with 20% discount for IISc students.