http://math.harvard.edu/~ctm/home/text/others/shannon/entrop...
"If the base 2 is used the resulting units may be called binary digits, or more briefly bits, a word suggested by J. W. Tukey"
http://math.harvard.edu/~ctm/home/text/others/shannon/entrop...