On: Fine tune LLAMA3 on million scale dataset in consu...

[Foobar8568]

I am still unsure where to stand on this fine tuning vs rag. I feel that for live data, rag would be preferable but for daily/weekly updated one, then fine tuning.

Another aspect where I am unsure is multi user for a model e.g. can we have concurrency for a model or the queries have to be queued.

[bigfudge → Foobar8568]

Fine tuning doesn’t ’add content’ the way RAG does though. They’re not really comparable in that way.

[Foobar8568 → bigfudge]

So more to be optimized for specific tasks in a domain ?