The point of ML is that you don't think about the rules explicitly, you let the algorithm figure them out from the data.
> how do they become so good at text continuation?
Good underlying algorithm (transformers do better than other algorithms we've tried) + lots of data.
I guess this isn't very satisfying but you're looking for some super deep and profound answer and there is none.
The point of ML is that you don't think about the rules explicitly, you let the algorithm figure them out from the data.
> how do they become so good at text continuation?
Good underlying algorithm (transformers do better than other algorithms we've tried) + lots of data.
I guess this isn't very satisfying but you're looking for some super deep and profound answer and there is none.