We're going to original sources for InformationTheory. This serves the joint purpose of a) providing some background for UniformInformationDensity, and b) giving us all a good starting point for using InformationTheory in our StatsMiniCourse.
To read
The foundational paper in InformationTheory is [attachment:shannon-48.pdf Shannon '48].
Other sources
An elaboration of Shannon's ideas with a more computational linguistics bent is [http://lccn.loc.gov/63016192 Abramson '63].