On: Something weird is happening with LLMs and chess

[fires10]

Recognize and hand over to a specialist engine? That might be useful for AI. Maybe I am missing something.

[worewood → fires10]

It's because this is standard practice since the early days - there's nothing newsworthy in this at all.

[generic92034 → fires10]

How do you think AI are (correctly) solving simple mathematical questions which they have not trained for directly? They hand it over to a specialist maths engine.

[internetter → generic92034]

This is a relatively recent development (<3 months), at least for OpenAI, where the model will generate code to solve math and use the response

[cruffle_duffle → internetter]

They’ve been doing that a lot longer than three months. ChatGPT has been handing stuff off to python for a very long time. At least for my paid account anyway.

[nerdponx → fires10]

It is and would be useful, but it would be quite a big lie to the public, but more importantly to paying customers, and even more importantly to investors.

[anon84873628 → nerdponx]

The problem is simply that the company has not been open about how it works, so we're all just speculating here.

[skydhash → fires10]

Wasn't that the basis of computing and technology in general? Here is one tedious thing, let's have a specific tool that handles it instead of wasting time and efforts. The fact is that properly using the tool takes training and most of current AI marketing are hyping that you don't need that. Instead, hand over the problem to a GPT and it will "magically" solve it.

[scott_w → fires10]

If I was sold a general AI problem solving system, I’d feel ripped off if I learned that I needed to build my own problem solver and hook it up after I’d paid my money…