The main limitations of ChatGPT 3.5 for a non-programmer is that non-programmers don't know the right questions to ask; that 10% of functions it produces are buggy in ways the AI can't fix by itself; and that the source code for a useful program is longer than the context window, so it will for example generate a Vector class with "mul(b)" method and later try to call "multiply(b)".
I'm told GPT-4 is much better at bug fixes, and there are various options for longer context windows.
Knowing what question to ask, though? The AI seems to contain the knowledge to all the questions, as if I ask them for a list of questions I get a useful response; and now someone has to answer the meta-question of "how do you want to present those questions to a user?" as there are many ways…
I'm told GPT-4 is much better at bug fixes, and there are various options for longer context windows.
Knowing what question to ask, though? The AI seems to contain the knowledge to all the questions, as if I ask them for a list of questions I get a useful response; and now someone has to answer the meta-question of "how do you want to present those questions to a user?" as there are many ways…