@paraschopra clears up some misconceptions about entropy in this Tweetstorm. Worth a read.