Each group is improving but mix of groups is changing.
High IQ populations have low fertility vs low IQ groups having high. South Korea with IQ 106 has TRF of 1.17. Nigeria IQ 84 has TRF of 5.53.
A gain of IQs within groups will be dwarfed by the change between groups.
If you think IQ tests are bogus we can use other metrics, eg Europe had 2x the population of Sub Saharan Africa in 1950, now Africa is bigger but has produced no hard science Nobel prizes and no new technology (like South Korea's smartphones)
Smarts for scienfic advancement is not evenly spread across global populations.
It's possible to have population growth while the high IQ fraction shrinks. All evidence says this is the current state of the earth.