code EC525
credit_hours 3
title Information Theory & Coding
arbic title
prequisites EC422
credit hours 3
Description/Outcomes Introduction to coding and information theory.
arabic Description/Outcomes
objectives Understand the key modules of digital communication system. Understand encoders and decoders. Understand the channel encoders and decoders.
arabic objectives
ref. books Simon Haykin ,"communication Systems", John Wiely and Sons, 2001
arabic ref. books
textbook T. M. Cover, ?Elements of Information Theory?, 2nd Ed Wiley-Interscience
arabic textbook
objective set bullets
content set bullets
Course Content
content serial Description
1 Course outline and Review of probability theory
2 Representation of probabilities in matrix form ? Concept of in information theory
3 Average information & Entropy ? Joint Entropy and Conditional Entropy
4 Self and Mutual information
5 Maximum Entropy ? Channel capacity, Redundancy and efficiency.
6 Channel capacity of some special channels ? time rate of information
7 Simple derivation for Shannon?s formula for capacity , bandwidth and S/N of a channel + 7th week exam
8 Channel BW versus S/N ratio trade off ? Elements of coding
9 Efficiency of encoding process ? conditions for noiseless coding ? some encoding methods
10 Shannon binary encoding method ? Shannon-Fano binary encoding method
11 Block codes and maximum likelihood decoding ? Galois field arithmetic?s.
12 Linear block codes + 12th Week exam
13 Parity check codes - Error detection codes
14 Cyclic codes.
15 Different types of coding techniques.
16 Final Examination