But you cannot train an open weight model by yourself, and maybe there could some distributed training net ran by thousand of volunteers around the world in the future, but until we get there we will still be tied to BigCo (American, Chinese or wherever in the world) decisions.
You would need institutions to do this? What do we have besides global megacorps with the resources for this? Universities perhaps training models for their local catchment?
We'll probably see a few middle-tier countries like France or Japan training their own national LLMs that they can control. Even if it's expensive, this will eventually be just as critical to national sovereignty as having nuclear weapons. They don't want to be completely dependant on the USA or China.
