well https://github.com/ggerganov/llama.cpp/issues/6849 4k will work but "does n... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

homarp on April 23, 2024 | parent | context | favorite | on: Phi-3 Weights Released

well https://github.com/ggerganov/llama.cpp/issues/6849

4k will work but "does not support long rope which is use by 128k variant."

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact