On: Llama.cpp on a jailbroken PS5: run any GGUF model natively on the console

[robotswantdata]

Significantly slower and less capable than opus 5.5

However you can run comparable or better models than gpt4. Try to stay under 30b

[system2 → robotswantdata]

GPT-4 and Opus 4.8 were the models that started the AI craze. Now people look down on them.

[kadoban → system2]

Qwen 3.8 27b is a great model, but 2 bit quant of it is _not_ Opus 4.8 level.