To add to the other answer, Shannon's information is also sometimes called "surprisal". And it doesn't describe only what is not known, but rather what can be predicted. So if you can predict new information, it has low surprisal, even if it previously wasn't known (with certainty).
