Perhaps you could view books as a reason to be there, but not what you sell. A relaxed, wifi-heavy, comfy chair social space where you make your margins off selling coffee and sandwiches. Maybe even let people read the books without buying them. Keep a conversation going. Have visiting authors come and hang out. Like a cross between a library and a Starbucks.