Shallowness is one obvious problem (obvious to any bilingual person). The more troubling problem I’ve noticed is that occasionally it’s inexplicably outright wrong about basic things.
Anecdote time. One day in late 2017 (I remember that because of an event), a friend of mine read a Google-translated page in Chinese, and sent it to me (fluent in Chinese) because a statistics was “amazing”. I looked at it, turned out Google translated 万, meaning “ten thousand”, to “million”. Of course the number was unbelievably good. I honestly couldn’t think of how that happened.
I don't know about Chinese, but in Japanese, 万 is frequently used idiomatically in the same way we might in English use "a million"—just to mean "a whole hell of a lot."
You’re right, except it was a statistic like 2.8万, translated to 2.8 million. Your take could point to a possible cause, though, maybe also putting it under the “shallow” category.
(Additionally, when 万 is used in Chinese to mean a whole lot, I would translate it to “thousands of” or “tens of thousands of”.)
I once google-translated a russian technical document and it replaced all occurances of "мкВт" (microwatt) with "mW" (milliwatt). Took me a while to figure out why all stated powers were way off.
I get errors like this from Google Translate all the time. I assume it's because the engine is fully ML (which seems to be good at getting larger grammatical structures but sometimes mistakes individual words), as opposed to some kind of expert system approach (which can easily look up individual words but tends to make soup out of them).
As for the error you saw, here's a guess: a million yen is ten thousand dollars, so an ML agent trained on JP/EN text that discusses money might see those numbers crop up a lot in close proximity.
My favourite glitch in Translate happened around 2008, where in the en/ru pair it translated Bush as Путин (Putin) and Putin as Буш (Bush).
The reason was apparently that in the training corpus, where the English version said something like "Bush met with Putin", the Russian version tended to say "Putin met with Bush"
The verb is "incorrectly" used only if you assume that "pelosi" implicitly refers to female politician "Nancy Pelosi". You might infer that if Nancy was recently in the news, but that's a hard leap.
Anecdote time. One day in late 2017 (I remember that because of an event), a friend of mine read a Google-translated page in Chinese, and sent it to me (fluent in Chinese) because a statistics was “amazing”. I looked at it, turned out Google translated 万, meaning “ten thousand”, to “million”. Of course the number was unbelievably good. I honestly couldn’t think of how that happened.