...because your work projects are bigger, there's only so big a black box can get before you lose all comprehension of it, and splitting it to smaller black boxes the shapes of which you keep refining is programming, and the part of it LLMs currently can't do
I routinely see Astra extract related functionality into it's own file after it gets past a certain size, unprompted.
And prompted it can extract the black boxes if you tell it what the boxes are or what to look for.
Same for cleaning up tech debt after organic development, it's suggestions on how to simplify and modularize are good, but you need to prompt.
Given that the prompts are quite generic, "look for technical debt, suggest simpler architectures, what could be extracted in a separate module", it won't be long till it will do it on it's own.
With directed prompting like "aggressively refactor into short functions with intention-revealing names" (a paraphrase; I'll give it a few sentences to describe a general style), even Luna handles this pretty well IMX. I have too much pride in my own analytical skills to try something like "how would you refactor this for clarity?" followed by "do it", but I imagine it would at least result in a step in the right direction.
