Working with a founder on publishing an article about this (coming in the next day or two), basically, chat AI is limited in a number of ways. But the founder I'm working with believes it's best as a fuzzy logic api. In his case, he's got an app that runs load tests,and GPT4 is great for finding base URLs in HAR files (ignoring all the analytics and noisy URLs that get captured), then creating synthetic data for the load tests based on the fields on the page (comments, names, dates, etc etc). A lot faster than doing it by hand. And he's done a bunch of stuff on the backend to make the prompts very very narrow so Gpt doesn't go off the rails.
