Not surprised. These models are inherently stochastic and will therefore happily say A and ¬A when prompted multiple times. A fundamental difference to how humans operate. (You could say that humans are stochastic, too, but they're stochastic in different ways.)