Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> Put the LLM/agent/AGI/SI in a box with full access to the internet. Don't give it any instructions. Nothing. Not even a system prompt. What happens?

This doesn't even make sense. Without a system prompt, how will it know that it has tool access?

Put man in pitch-black room, why doesn't he read book or talk to me?



Actually man freaks out and starts hitting the walls.

But either way, setting that asides by “give it full access to the internet” I meant giving it the tools to access the internet.

It just won’t though. It has no need to.


The weights themselves are inert. It would be like complaining that a brain preserved in formaldehyde isn't thinking.

What you need is a loop. And if you try running an LLM in a loop with internet access, it will eventually use it.


What does an LLM with zero instructions do nowadays with no loop? It's basically just noise spilling from the weights and "snapping" to the closest actions/tools , with no real signal going through?


But that's exactly it. It doesn't 'know'. It isn't. It's a possible story nobody told. There is nothing there.


Your brain cut off from any stimulus doesn't "know" either. There are a lot of reasonable arguments to be made against AI, but this isn't one of them.

Tool bad because I used it wrong.


“Know” isn’t a perfectly useful word here. The mind still experiences sans material stimulus, for example dreaming. And it experiences in a progressively less goal/immediate-task-relevant-stimulus manner as stimuli go down (default mode network activity, seen in dreaming, sensory deprivation etc) - i.e. the mind experiences, and processes (dreams about taxes, and so on) independent of the world.


Is anyone under the apprehension that LLMs are human brains? I don't think so.

Clearly there are differences. I believe that during a response, there is some amount of experience or thinking happening. Obviously, it's not continuous experience like ours.




Consider applying for YC's Winter 2027 batch! Applications are open till November 2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: