Maybe, though you might be surprised - first Upwork guy I hired did insanely bad work that was obviously horribly wrong, and I ended up getting it all refunded.
But in any case, tremendous errors won't actually cause me big problems, because I'd catch them on my review of the P&L. Small errors I might miss (whether committed by human or LLM), but they're not going to be material anyway.
Sure, and I do my own accounting in Google Sheets. Each brand that I own is pretty simple, so this isn't that hard (and it's important to me that I do it myself to maintain context on my businesses).
That's why an LLM is good for bookkeeping for me - I'm not actually using the books in any strategic capacity, and I know the numbers in the business well enough that I'll catch any obvious mistakes. The books are purely to give to my CPA to do my taxes at the end of the year.