Wouldn't that only really apply while doing intensive memory accessing. Something that you would probably only be doing a very small percentage of time.
no - simply refreshing memory state costs power. The DRAM memory refresh cycle happens about every 60ms. In the background, memory cells are constantly read and rewritten.