I agree in theory with you. But you can 'bank' labour for later on. Building infrastructure (that will last) when you have a population bulge, means that the generations after can take advantage of that infrastructure, and have to do the lower amount of work, of maintaining it. This can go for things like education, investing in businesses, and generally any capital.
Of course you can also over build this capital that will never be used, but will need to be paid back (for example a local government pays to build a town that there are no people to fill it with) and the maintenance is too much, but you still have to look after the people who did the building.
Of course you can also over build this capital that will never be used, but will need to be paid back (for example a local government pays to build a town that there are no people to fill it with) and the maintenance is too much, but you still have to look after the people who did the building.