Differences between revisions 6 and 7

I won't actually be at this meeting, as I'm going to my brother's college graduation. I'll be making notes on this page that will hopefully help to get discussions started, but it would be great if someone wanted to volunteer to lead the meeting. -- AustinFrank DateTime(2008-05-14T23:36:17Z)

We're going to the original source for InformationTheory. This serves the joint purpose of a) providing some background for UniformInformationDensity, and b) giving us all a good starting point for making connections to InformationTheory in our StatsMiniCourse.

Required reading

The foundational paper in InformationTheory is [attachment:shannon-48.pdf Shannon '48]. Read at least through page 28 of this PDF file. Pay special attention to Part II, starting on page 19.

Other sources

An application of the ideas in the '48 paper is in [attachment:shannon-51.pdf Shannon '51], "Prediction and Entropy of Printed English".
Shannon's most recent paper on the topic that I could find is [attachment:shannon-84.pdf Shannon '84]. It discusses transmission rates under different noise conditions.
[http://lccn.loc.gov/63016192 Abramson '63] is apparently a good text that is now out of print.
[http://lccn.loc.gov/97014382 Kullback '97] is a reprinting of an early text on connections between statistics and InformationTheory.

-  ⇤ ← Revision 6 as of 2008-05-14 23:36:41 → 
  Size: 1511
  Editor: colossus
  Comment:
+   ← Revision 7 as of 2008-05-14 23:37:07 → ⇥
  Size: 1527
  Editor: colossus
  Comment:
-Deletions are marked like this.
+Additions are marked like this.
 Line 9:
-We're going to the original source for InformationTheory.  This serves the joint purpose of a) providing some background for UniformInformationDensity, and b) giving us all a good starting point for using InformationTheory in our StatsMiniCourse.
+We're going to the original source for InformationTheory.  This serves the joint purpose of a) providing some background for UniformInformationDensity, and b) giving us all a good starting point for making connections to InformationTheory in our StatsMiniCourse.