I have the same experience, my major is filled with statistics and math and coming out of high school I didn't have the right prerequisites. Nonetheless, a decent amount of interest and some hard work and I got up to speed in no time. Calculus was a breeze after that. It goes for a lot of things really, when you're interested in the subject and willing to work for it, it becomes so much easier. I now just have a "How hard can it be?" attitude towards stuff.