Course

code	EC525
credit_hours	3
title	Information Theory & Coding
arbic title
prequisites	EC422
credit hours	3
Description/Outcomes	Introduction to coding and information theory.
arabic Description/Outcomes
objectives	Understand the key modules of digital communication system. Understand encoders and decoders. Understand the channel encoders and decoders.
arabic objectives
ref. books	Simon Haykin ,"communication Systems", John Wiely and Sons, 2001
arabic ref. books
textbook	T. M. Cover, ?Elements of Information Theory?, 2nd Ed Wiley-Interscience
arabic textbook
objective set	bullets
content set	bullets

Course Content

content serial	Description
1	Course outline and Review of probability theory
2	Representation of probabilities in matrix form ? Concept of in information theory
3	Average information & Entropy ? Joint Entropy and Conditional Entropy
4	Self and Mutual information
5	Maximum Entropy ? Channel capacity, Redundancy and efficiency.
6	Channel capacity of some special channels ? time rate of information
7	Simple derivation for Shannon?s formula for capacity , bandwidth and S/N of a channel + 7th week exam
8	Channel BW versus S/N ratio trade off ? Elements of coding
9	Efficiency of encoding process ? conditions for noiseless coding ? some encoding methods
10	Shannon binary encoding method ? Shannon-Fano binary encoding method
11	Block codes and maximum likelihood decoding ? Galois field arithmetic?s.
12	Linear block codes + 12th Week exam
13	Parity check codes - Error detection codes
14	Cyclic codes.
15	Different types of coding techniques.
16	Final Examination