Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

For LLM inference in production we use vLLM (with our own model).


did you fine tune another model, and if so which one?


Not really fine tuned. But the base was Qwen. We are analyzing images




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: