I would never consider biking downtown, at least not yet.
I ride between 5,000-10,000 miles a year. I've had several crashes due to my own fault or other cyclists' faults in races. I've also been hit once and suffered a very minor broken wrist that healed in three weeks. I am pretty lucky.
Some of my friends have been in crashes with cars and they are all fine. It was scary at the moment and they got hurt, with some injuries such as a broken collarbones, but they're all still riding and healthy today.
Of course, they all LOVE riding bikes. If you don't love to ride bikes, it's tough to "get on that horse after it bucks you off," so to speak.
I want a pony. =)