How much memory does this use of the test machine's (M3 Max) 128 GB unified memo... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		altano 7 days ago \| parent \| context \| favorite \| on: Laya on Mac M4 CoreML Offline How much memory does this use of the test machine's (M3 Max) 128 GB unified memory?
		help

WASDx 7 days ago | [–]

The model is only 0.3B params so probably not much.

ImJasonH 6 days ago | | [–]

I had Fable one-shot the same demo from the same weights on an iPhone 15 Pro and it decides in ~40ms.

putna 7 days ago | [–]

Physical footprint: 560.4M Physical footprint (peak): 778.0M

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact