My point is that there are already mathematical proofs in the literature that show that LLMs literally are doing algorithmic reasoning.
This has been proven by category theory, in the area of GNNs (for which transformers are a trivial subset).
Sorry if I'm going over too much basics, as this is obvious and well understood by anyone actually in the field, to the point of being excessively boring.