|
Size: 980
Comment:
|
Size: 1147
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 9: | Line 9: |
| = To read = The foundational paper in InformationTheory is [attachment:shannon-48.pdf Shannon '48]. |
= Required reading = The foundational paper in InformationTheory is [attachment:shannon-48.pdf Shannon '48]. Read at least through page 28 of this PDF file. |
| Line 13: | Line 13: |
| * An elaboration of Shannon's ideas with a more computational linguistics bent is [http://lccn.loc.gov/63016192 Abramson '63]. | |
| Line 16: | Line 15: |
| * [http://lccn.loc.gov/63016192 Abramson '63] is apparently a good text that is now out of print. * [http://lccn.loc.gov/97014382 Kullback '97] is a reprinting of an early text on connections between statistics and InformationTheory. |
We're going to original sources for InformationTheory. This serves the joint purpose of a) providing some background for UniformInformationDensity, and b) giving us all a good starting point for using InformationTheory in our StatsMiniCourse.
Required reading
The foundational paper in InformationTheory is [attachment:shannon-48.pdf Shannon '48]. Read at least through page 28 of this PDF file.
Other sources
- An application of the ideas in the '48 paper is in [attachment:shannon-51.pdf Shannon '51], "Prediction and Entropy of Printed English".
- Shannon's most recent paper on the topic that I could find is [attachment:shannon-84.pdf Shannon '84]. It discusses transmission rates under different noise conditions.
[http://lccn.loc.gov/63016192 Abramson '63] is apparently a good text that is now out of print.
[http://lccn.loc.gov/97014382 Kullback '97] is a reprinting of an early text on connections between statistics and InformationTheory.