Also, people tend to take the redirect as a hint about the canonical name of the site. If nothing else, people copying from the location bar or from other links will tend to end up with the version you redirect to. Only people who manually type URLs (and don't check them with the site to see where they end up) will use the non-canonical name. Between that and the search engine canonicalization mentioned above, I see little danger in redirecting one name to the other so both work.
And on the flip side, making both names work ensures that if anyone does visit or link to the wrong name, they still end up at your site. Intentionally giving a "server not found" error or similar seems like significantly worse behavior.