On: Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs

[philipkiely]

Yeah we have tried to build calculators before it just depends so much.

Your equation is roughly correct, but I tend to multiply by a factor of 2 not 1.2 to allow for highly concurrent traffic.