The Turing test should introduce a completely unexpected set of questions. (double quotes for human, single for AI) "Hi" 'hi, how are you?' "Good. Do you know what we are doing today?" 'Yes, we are attempting to prove that I posses sentient intelligence' "Right. Would you like to prove that you are sentient?" 'Yes' "Excellent. I would like you to design a new five wheeled vehicle for me, can you do that?" 'Yes. Is autocad acceptable?' "Sure. Start with basics though, don't dive in, I'd like to see successful iterations and reasoning about design choices"
Something like that. Otherwise it's all just BS breadth first search through other people's past conversations.
I think the difference is undirected AI. We're getting quite good at defining a task, like voice recognition, and applying AI to solve it, but we still have basically no idea how to handle undirected human-like intelligence. And I think that's perfectly fine.
No, I mean my point is that any arbitrary human would have difficulty handling a random, untrained for technical task at the level of designing a vehicle in a drafting program like AutoCAD.
Maybe what you want to say is, "I would like you to spend 4 to 10 years learning how to build a 5 wheeled vehicle." Then maybe the AI comes back to you and says, "Is MIT an acceptable institution to learn these skills at?"
Something like that. Otherwise it's all just BS breadth first search through other people's past conversations.