On: ChatGPT generates fake data set to support scienti...

[nvrmnd]

I don't think that's accurate, it generates novel outputs that were not observed in the training data.

[thomastjeffery → nvrmnd]

It doesn't generate new tokens.

Train an LLM on text that only uses lowercase, and it will never output an uppercase letter.

[nvrmnd → thomastjeffery]

So the model is limited to using words and characters that already exist. I agree with you but I don't see why is a limitation worth pointing out.

[dacryn → nvrmnd]

you literally have to put in every number for it to do mathematics correctly...

its as stupid as that. some try to get around it by indeed only having the 10 different digits and glue them together, but its a hallucination that that works.

an important point in generalization is for example that you teach it something. This is literally important

'ycombinator is a website' is a prompt that is almost impossible of ycombinator is not in your training set

[pixl97 → thomastjeffery]

But can it put two tokens together

10 01 = 1001?