On: Gemma 2B 60 tk/s WebGPU on M1

[mjks]

But is it saying "'affor affor affor...(repeated 100+ times)" really fast?

But actually, did you download the linked model from Kaggle ("gemma-2b-it-gpu-int4.bin") and upload it into the demo? It is working fine for me out of the box.

[qrian → mjks]

yes, I loaded the 1.35GB .bin file.

[hackerrrrx → qrian]

Are u using 'gpu' one? what's your platform. my mbp2019 seems good