Indeed. Imagine having to lower real estate prices because demand falls. Fossil fuel use going down, less useless crap produced for less people, less pollution. Having to raise wages because of less unskilled labour available.
My counter argument is that humans are more wasteful when faced with abundance. Look at what we did when we discovered two continents worth of land. When perceived costs are low, waste is high.
Sounds like a nightmare (for some).