I bore/regale/tell/tormwnt everyone I talk with about anything math related, that mathematics and calculation (with numbers) is entirely different abilities. I do this because I've heard so many stories similar to your about people thinking they are bad at math where the only issue turns out to be the digits, numbers, and holding them in you head. Which, quite frankly is not something very relevant to most of mathematics, and as you relate, when you get at ease with the actual math, dealing with numbers usually gets a bit easier.
If not, there exists specific training that helps a significant fraction of people to get better at handling the actual numbers, training which also is completely unrelated to maths.
If not, there exists specific training that helps a significant fraction of people to get better at handling the actual numbers, training which also is completely unrelated to maths.