Above is a pdf on the topic of entropy, as introduced by Shannon. I wrote these mostly for my benefit as I needed to brush up on some basics of entropy to read this paper of Tao. As a result these notes are largely informal.

Above is a pdf on the topic of entropy, as introduced by Shannon. I wrote these mostly for my benefit as I needed to brush up on some basics of entropy to read this paper of Tao. As a result these notes are largely informal.