I would like to thank Professor Joseph
A. O'Sullivan for being kind enough to allow me to make use of the valuable material from
his course in Information Theory:.
Lecture
1 provides a good overview of the subject.
Lectures
2-6 pursues the material in my recent lecture in far greater detail than I did but, taking that
into account, provides an very valuable alternate treatment of this material.
Professor Natasha Devroye has graciously allowed us to access material
from her course in Information Theory, as well. For the exam on March 12, materials in the Introduction
and Chapters 2,5, and 7 are particularly relevent:
Starting with background, I will suggest material in Grinstead and Snell's Introduction
to Probability to review at various times. I will focus on Discrete Probability.
Mathematics
for Computer Science from the Massachusetts Institute of Technology OpenCourseWare project
contains very useful material on a number of topics, including Probability.
Entropy and Information Theory
First Edition by Robert M. Gray is a more technical treatment of material in this course.
Models of Computation by John Savage provides a through review of the Theory of Computation
Introduction to Theory Of Computation. by Anil Maheshwari and Michiel Smid excellent study resource for material I will
cover in the second half of this course.