Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Phi-3 is five months old now. I suggest trying Phi 3.5 instead - it's effectively the same size (2.2GB from HF - Phi-3 Mini is 2.2GB as well) but should provide better results.

If you have Ollama installed for that there are plenty of other interesting models to try out too. I like the Llama 3.2 small models, or if you have a whole lot of RAM (I use 64GB on an M2 MacBook Pro) you can run Llama 3.3 70B which is genuinely GPT-4 class: https://simonwillison.net/2024/Dec/9/llama-33-70b/



How does Llama-3.2 3B compare to Phi-3.5?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: