On: We're releasing the weights of Mistral Large 4

[jacquesm]

Ugh, ok that's out of my league :) Almost though, another 32GB and it would work.

Thanks for the link, appreciated!

[justauserid → jacquesm]

Not sure what league people with a five-year old M1 Pro with 16GB of unified RAM fall into :)

[jacquesm → justauserid]

Oh, that's a tough one. Do you have a fast drive? If you do you might try a 3 to 5B active MOE model, use the rest as cache to stream weights from NVMe. That would be your best bet. You'll be in the 'optimization league' ;)