Hacker News new | past | comments | ask | show | jobs | submit login

Anyone know the Wattage this will pull?

Assuming the CPU is just ARM it should run pretty decently low on idle, might work for a homeserver.




If you need an LLM on your home server, sure. If not, there are much more sensible home server options based on Intel’s N100 or Microsoft’s SQ3 chipsets.


Yeah I do need the LLM.

Currently running 2 old Tesla M40's for 48GB of VRAM.

While cheaper than this it has its limitations. Running a 200B model locally is very attractive though. Excited for the future.




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: