I think I'm gradually getting a picture of what jev does, and why it might be good:
1) one shot classifiers are great, and are well-known.
2) LLMs are also great classifiers, but are slow at output - and not great at guaranteed structured output.
3) everyone focused on LLMs, and forgot about classifiers.
4) any decent one shot classifier should be easy to run "fast"/"in realtime".
5) combining 4) with LLMs and a harness (a loop) open up some clever use-cases that LLMs alone are too slow for.
As I understand it, jev isn't long for this world (we'll have foss one shot classifiers we can run on modest hardware) - but it seems likely the legacy will be that classifiers will re-gain some prominence alongside generative models.
I think I'm gradually getting a picture of what jev does, and why it might be good:
1) one shot classifiers are great, and are well-known.
2) LLMs are also great classifiers, but are slow at output - and not great at guaranteed structured output.
3) everyone focused on LLMs, and forgot about classifiers.
4) any decent one shot classifier should be easy to run "fast"/"in realtime".
5) combining 4) with LLMs and a harness (a loop) open up some clever use-cases that LLMs alone are too slow for.
As I understand it, jev isn't long for this world (we'll have foss one shot classifiers we can run on modest hardware) - but it seems likely the legacy will be that classifiers will re-gain some prominence alongside generative models.