Still, what you prove for all naturals in Math still works for a finite number of them so the limitations in CS are just arbitrary, I don't think they matter much philosophically
They matter in what problems each field focuses on. And the idea that the natural numbers are all the same, but infinities have different character can be seen as arbitrary as well (cf. set theory).