Hacker News new | past | comments | ask | show | jobs | submit login

> most people have no use for that

Apple originally added their NPUs before the current LLM wave to support things like indexing your photo library so that objects and people are searchable. These features are still very popular. I don't think these NPUs are fast enough for GenAI anyway.






MS Copilot and "Apple Intelligence" are running a small language model and image generation on the NPU so that should count as "GenAI".

It's still in beta so we'll see how things go but I saw someone testing what Apple Intelligence ran on-device vs sent off to the "private secure cloud" and even stuff like text summaries were being sent to the cloud.

I wish I could turn that off on my phone.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: