I never thought about that. I actually think this is a great idea.
One big issue is a lot of people would be upset at the idea of their reputation getting smaller.
Maybe have a new "influence" or "helpfulness" score along with reputation that takes into account the decay you are talking about. Or maybe just have a different scoring mechanism altogether based on how knowledgeable and helpful your are to the SO community.