On: My process to get 6-11X speedup running Qwen3.6 on my RTX 4090, full repo.

That would have to be more heavily quantized right? It's a 128bn vs 35bn? How much does that affect it?

You can run flash-next on a 4090 at a 4bit quantization, which is by most accounts close enough.

It looks like OP is starting with the bf16 unquantized qwen3.6-35b-a3b, but I couldn't tell if they are quantizing it down from there or not.

I kept the 35B fixed for the hill climb to see how much runtime changes each change.