Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
snerbles
9 days ago
|
parent
|
context
|
favorite
| on:
Show HN: Llmspeed – feel how fast a local LLM runs...
I get about 50 t/s with the same model on a 3090, with about 100K context. I usually set harnesses to 90k.
It would be neat to also include NVFP4 variants for the Blackwell hardware.
help
Consider applying for YC's Winter 2027 batch!
Applications
are open till November 2.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
It would be neat to also include NVFP4 variants for the Blackwell hardware.