It may be difficult, but it's often the right approach. Difficult things are often the right thing when it comes to social interaction and dealing with other people. Nobody likes it, and unless you're a Narcissist or similar, it is never completely easy. It tends to take work and practice.
For me, the path out was making myself speak publicly.
I think these are areas that definitely get a lot easier with age.