On: Snowflake Arctic Instruct (128x3B MoE), largest open source model

[EVa5I7bHFq9mnYK]

I've seen estimates that training gpt3 consumed 10GWh, while inference by its millions of users consumes 1GWh per day, so inference Co2 costs dwarf training costs.