Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
alfiedotwtf
6 months ago
|
parent
|
context
|
favorite
| on:
Running Gemma 4 locally with LM Studio's new headl...
The default context is 128k for the smaller Gemma 4’s and 256k for the bigger ones, so you’re cutting off context and it doesn’t know how to continue.
Bump it to native (or -c 0 may work too)
pshirshov
6 months ago
|
next
[–]
In that case the model descriptor on ollama.com is incorrect, because it defaults to 16k. So I have to manually change that to 64/128k. I think you are talking about maximum context size.
trvz
6 months ago
|
prev
[–]
No, the default context in Ollama varies by the memory available:
https://docs.ollama.com/context-length
Consider applying for YC's Winter 2027 batch!
Applications
are open till November 2.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
Bump it to native (or -c 0 may work too)