MENU

Course Jukebox

Course Jukebox

Course Detail

Degree
Master
Standard Academic Year
Course delivery methods
face-to-face
Subject
Computer Science
Program
School
College of Electrical Engineering & Computer Science
Department
Campus
Classroom
Course Offering Year
Course Offering Month
September - November
Weekday and Period
Wednesday 234
Capacity
Credits
3
Language
English
Course Number
EE5028

Information Theory National Taiwan University

Course Overview

Information Theory is a senior (undergraduate) level course designed for students who are interested in the quantitative fundamental limits of information. What is information and how to quantify information? What is the ultimate data compression rate and what is the ultimate transmission rate of communication? In this course, we introduce the fascinating theory originated from Claude E. Shannon, which addresses the above fundamental questions in communication theory. We will develop methods and coding techniques to achieve these fundamental limits. Finally, we will also demonstrate the application of information theory to other fields, including statistics (hypothesis testing and estimation) and statistical inferences.

Learning Achievement

1. Introduce basic topics in information theory, including measures of information, source coding theorem, channel coding theorem, and source-channel separation. 2. Develop methods and coding techniques to achieve these fundamental limits. 3. Show applications of information theory beyond communications, especially in high dimensional statistics and statistical inferences.

Competence

Course prerequisites

Prerequisite: Probability, Linear Algebra, Optional: Random Processes, Communication Systems Homework (30%), Midterm (30%), Final (40%)

Grading Philosophy

Course schedule

Course type

Online Course Requirement

Instructor

I-HSIANG WANG

Other information

Site for Inquiry

Please inquire about the courses at the address below.