I think the main problem is we compete for these resources with them. And in many ways jam the ecosystem from reaching equilibrium so the bad years become more frequent and are not followed by good years at the same rate.
I watched the matrix when I was too young to understand much. But when I watched it a few years later it just hit me and this quote of Agent Smith has stayed on my mind
"I'd like to share a revelation that I've had during my time here. It came to me when I tried to classify your species and I realized that you're not actually mammals. Every mammal on this planet instinctively develops a natural equilibrium with the surrounding environment but you humans do not. You move to an area and you multiply and multiply until every natural resource is consumed and the only way you can survive is to spread to another area"
