> the best use, arguably, of an LLM is as a very fast search index for common information
I'd counter forming a rebuttal against a search result would be fairly trivial. I.e an AI summary for "are oranges poisonous" would say "Moms Against Big Citrus says oranges are poisonous, but the Association of Orange Groves says they are not." When used for search, LLMs are a source for sources instead of the source of truth itself. The user decides which source to believe instead of deciding to believe the LLM itself.
> you might be fortunate to be in a position where nobody is relying on your velocity to ship products at competitive speed.
Admittedly the biggest drawback. AI is pretty terrible at my profession (electrical engineering, regardless of recent demos that are horrendous when examined under a microscope), but the software engineers I know haven't hand written industry code in months.
I'd counter forming a rebuttal against a search result would be fairly trivial. I.e an AI summary for "are oranges poisonous" would say "Moms Against Big Citrus says oranges are poisonous, but the Association of Orange Groves says they are not." When used for search, LLMs are a source for sources instead of the source of truth itself. The user decides which source to believe instead of deciding to believe the LLM itself.
> you might be fortunate to be in a position where nobody is relying on your velocity to ship products at competitive speed.
Admittedly the biggest drawback. AI is pretty terrible at my profession (electrical engineering, regardless of recent demos that are horrendous when examined under a microscope), but the software engineers I know haven't hand written industry code in months.