Nice work, it would be great to see some benchmarks comparing it to llm.c. | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

fuddle 71 days ago | parent | context | favorite | on: Lm.rs: Minimal CPU LLM inference in Rust with no d...

Nice work, it would be great to see some benchmarks comparing it to llm.c.

littlestymaar 71 days ago [–]

I doubt it would compare favorably at the moment, I don't think it's particularly well optimized besides using rayon to get CPU parallelism and wide for a bit of SIMD.

It's good enough to get pretty good performance for little effort, but I don't think it would win a benchmark race either.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact