Now I'm curious if anyone has or might try to create an LLM that lacks all knowledge of the post-einstein/newton/plato world and see if it can figure things out. I imagine lack of training data would be a problem, but maybe it could be a way to reverse-engineer an effective prompt that can give us insight in the platos of our world?
> I imagine lack of training data would be a problem
I imagine that's an understatement. Using only the written works available from before Einstein (let alone Newton or Plato), you'd probably need a whole new technology that could train itself without any training data other than observation of the world.
arguably it is feasible in principle to filter out that knowledge from later writings, but you can always say it leaked in a subtle way - "this chonky cat is bending space around it" (this is exaggerated, can be much more subtle and hard to notice)
They would need to be much better at learning. You can teach a child how to drive a car and they can be good enough at it that the state will grant them a license to drive.
Where's the learning robot that I can teach to drive a car in the same way? They can solve some complex math problem but can they read the cues of other drivers at a four way stop to know when they should go (knowing the rules isn't sufficient).
