I do remember much of what I read. I also have (what I take to be) an unusual quirk in that I'm very risk averse in reading--often I would rather reread a book I know I enjoy (and have gotten insight from) than risk an unknown. At first I thought that my retention might come from the rereading, but I'm not sure that's the case, since I have plenty of examples of remembering things after reading them once. In fact I think the rereading is caused by the retention: if what you read sticks in your head, a negative experience or a waste of time is that much more costly.