On: DBRX: A new open LLM

[zozbot234]

That's system memory, not unified memory. Unified means that all or most of it is going to be directly available to the Apple Silicon GPU.

[giancarlostoro → zozbot234]

This is the key factor here. I have a 3080, with 16GB of Memory, but still have to run some models on CPU since the memory is not unified at all.