I disagree. A program/repository is not a big chunk of text. It's more like logic to perform a particular function represented in text which is a symbol of language.
"To think that reducing entropy/complexity in a system is some inherently human capability is both anthropo-centric and full of hubris."
Humans invented LLMs and Agents etc, designed, programmed, etc. etc. Seems they are more an extension of humans -- tools that rely on humans.
An LLM/Agent left to it's self on a code base does cause entropy. I've only ever seen them not cause entropy on the first prompt.
Any text edits (insertions, deletions) that a human is capable of doing, so is an agent/LLM
To think that reducing entropy/complexity in a system is some inherently human capability is both anthropo-centric and full of hubris.