On: Show HN: OfflineLLM – a Vision Pro app running Tin...

[jsheard]

Apparently 16GB iPads set the line at 5GB per app by default, and while that flag lets you request more they don't make any guarantees of how much extra quota you will get, so I'm not sure how useful that is for loading a big model if it might randomly fail. I suppose it's probably safe to assume the Vision Pro is similar.

https://9to5mac.com/2021/06/25/apps-can-request-access-to-mo...

[samstave → jsheard]

>request more they don't make any guarantees of how much extra quota you will get

How is the logic made for what requests get what?

Maybe a new feature in future iOs would be a user setting for specific apps to slider how much the user wants to allot - and a toggle to "shed other apps as needed" and "shed other apps when temp reaches X"

[kalleboo → samstave]

> Maybe a new feature in future iOS would be a user setting for specific apps to slider how much the user wants to allot

And Apple even has a UI design ready for this https://kalleboo.com/linked/system7memorymanagement.png

[dannyw → samstave]

I’ve tested this. On an iPad it always works in my testing on devices with lots of RAM, unless your app is in split screen mode.

[wahnfrieden → samstave]

Apple will never do that. And the algo is undocumented.

[virusduck → samstave]

Hello, System 7!