Kardashev looked at the physics in 1964 and said that civilizations that don't grow fast enough (energy use requiring expansion to other planets) risk planetary catastrophes and would not be expected to survive many thousands of years. Sure Earth could get lucky, but betting on that seems irrational.
In the limit, all arguments of doom-and-gloom come true.
The same argument of destruction of solar system, milky way and our galactic super-cluster can be made for different time scales. Even universe is expected to fizzle out.
Though I agree there are no easy answers. Risk will always be there, but we should realize that hedging one type of risk exposes us to other types of risks.