Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Yet when you model an Enigma machine, it does encrypt and decrypt messages.


I'd argue that if it encrypts and decrypts, then you've built an enigma machine, not modeled it.


Then, presumably, you will also hold that when you have digitally modeled a brain such that the model responds to its inputs as a brain does, then you have built a brain.

Tendentiously redefining the word "simulation" in an attempt to avoid the awkward cases is not going to save an argument that was dead on arrival.


I will indeed hold that, and it was my point to go to against post you were replying to and bolster your position. They try to make a point about modeling but they back it up by talking about virtually modeling real, physical processes. If I model a hurricane with a computer nothing gets wet. If I model a hurricane with giant fans and sprinklers then things do get wet and, if I'm able to achieve a certain level of fidelity with my giant fans and sprinklers then whether or not i've made a hurricane is a rather arbitrary distinction as your living room is several blocks from where it was yesterday regardless of whether it was put there by a real hurricane or a mere model.


Ah, thanks - I thought you were trying to save the "a simulation is never the real thing" by substituting a different word when it is clear that the simulation is doing what the real thing does. This is a tactic I think of as "lexical hacking" and it is surprisingly common among philosophy-of-mind academics.


If someone digitally modelled a nuclear reactor, would any energy be produced?

No, because the simulation is actually missing an important aspect, namely the causal part that exists with the physical material but not in the simulation. It’s actually that it’s missing these components that makes it a simulation and not the real thing. But for that you need the physical material.

So why would it be different for the brain? If nuclear energy can’t arise from abstract relationships, why would consciousness or anything else?


>So why would it be different for the brain? If nuclear energy can’t arise from abstract relationships, why would consciousness or anything else?

Because consciousness isn't something the brain produces like a hormone or an excited particle. Consciousness isn't an output of the brain that is somehow separate from it, it is the manner in which the brain processes sensory information and makes decisions to produce output.

The causal context in which brain dynamics occurs is orthogonal to the relevant properties regarding consciousness. Consciousness is a state characterized by certain kinds of information processing, namely that which carries relevant semantics of the organism encoded in a way that maximizes effective control by the executive center. Consciousness is the rich semantic space in which the executive center engages to affect highly competent control of the organism. It is substrate independent information processing.


This is a decent summary of functionalism but it doesn't provide any concrete justification for it. We both agree that the brain processes information. The question is if a sufficiently abstract description of that processing captures everything physically constitutive of consciousness. How would you support your position that it does?


It's really the only live option once the issues are properly understood. Causal closure: a physical event is explanatorily exhausted by prior physical events. Causal exclusion: if physical properties fully cause/explain everything we say and do about consciousness, i.e. our behavior purported to be about consciousness, then consciousness cannot be distinct from the physical behavior and also be a cause of that behavior. For example, for our speech acts to be about consciousness, consciousness must be causally involved in their generation. Hence, consciousness is a second-order physical property of the same category as the information carried by the speech acts about consciousness. That is, consciousness is an abstract property of physical organization.


It's a massive leap to go from consciousness must be causally integrated with physical brain activity to consciousness is exhausted by an abstract functional description of that activity. At best you could establish that consciousness cannot be an additional, independent cause outside the physical causal order.


Causal integration + causal closure is a wrap for non-abstract theories. The so-called biological theories of consciousness are just wishful thinking.


How so?


A corollary of causal exclusion is that two causally identical systems have identical explanations for identical physical events. If you posit some property of a substrate purported to be relevant for consciousness, it will either have a causal influence or non-causal influence. Given causal closure, any causal influence is explained by prior physical events, thus bypassing any relevance of this special property (or this special property is just identical to some physical event). If the influence of this special property is non-causal, then due to causal exclusion it can't have any explanatory relevance to causally downstream behavior. E.g. it is causally excluded from relevance to speech acts about consciousness. You're left with some kind of non-physical, non-causal influence. In other words, wishful thinking.

Two further points. Modern physics has been described as "topic neutral"[1] in the sense that it doesn't posit the intrinsic nature of the substrate being described, only describes its behavior. Thus physics properly understood is itself multiply realizable: the behavior of physics can be "implemented" in dissimilar substrates with a range of intrinsic properties. But, according to the argument just outlined, these intrinsic properties can't play any explanatory role in the unfolding of physical dynamics (outside of bare implementation).

The other point is that this argument is fully general in the sense that any closed explanatory regime causally excludes phenomena not captured by entities defined within the explanatory regime. The explanatory regime of abstract semantic information is another such closed regime. Thus, for our speech acts, i.e. abstract semantic information, to be about consciousness, consciousness must be captured within the explanatory regime of abstract semantic information.

[1] https://chomsky.info/201401__/


You said “Given causal closure, any causal influence is explained by prior physical events, thus bypassing any relevance of this special property.”

That does not follow. A property being physically caused does not make it causally irrelevant. For example, a wire’s conductivity is produced by its physical microstructure. Its conductivity helps explain why current flows through it. The fact that the conductivity itself has a physical explanation does not “bypass” its relevance. Likewise, suppose some biochemical property of neurons is essential to consciousness. That property could be entirely physical, caused or constituted by prior physical conditions, causally relevant to later neural activity, and omitted by some abstract computational description.

“Causally identical” already assumes much of the conclusion, and causal relevance is not the same as constitutive relevance. You also conflate “caused by physical events” with “identical to a physical event”. Properties are not usually identical to events. Events possess or instantiate properties. More importantly, this still would not establish functionalism.


>You said “Given causal closure, any causal influence is explained by prior physical events, thus bypassing any relevance of this special property.”

You're taking the sentence out of context and missing the work it is doing. Given some special property, if it doesn't have causal influence, then it is explanatorily impotent. If it does have causal influence then it is just a standard physical property subject to laws and such, i.e. non-special.

> For example, a wire’s conductivity is produced by its physical microstructure. Its conductivity helps explain why current flows through it. The fact that the conductivity itself has a physical explanation does not “bypass” its relevance.

Yes, conductivity is just a physical property (in my quote you left out the parenthetical about being identical to some physical event). It is explanatorily relevant because it is definable within the explanatory regime of physical dynamics.

>Likewise, suppose some biochemical property of neurons is essential to consciousness.

This is the meat of the issue so I will focus on this. The question is what kind of property could a biochemical property be that is not abstract and is crucial for consciousness? My argument is that there are no suitable properties to play the necessary role of grounding consciousness in the "real world" while denying it in a virtual/simulated world. The remainder of the space of candidate properties are non-physical, unscientific, and ultimately wishful thinking.

Given the idea that biology/chemistry reduces to physics, this strongly constrains the space of candidates for a biochemical property to ground consciousness. The content of physics is structure, dynamics, conservation laws, fields, probability, etc. The equations of physics don't describe consciousness, but the behavior and constraints on the entities quantified over. Note that as the equations of physics quantify over relevant entities, they are abstract. To say a biochemical property is crucial for consciousness is just to say that a physical property, broadly construed, is crucial for consciousness. Candidate properties can be divided into two sets: the structure, dynamics, etc of the content of physical theories (we can call these relational properties), and any non-relational/intrinsic properties that are not the content of physical theories but are relevant to the realization of physical events. These latter properties are not the subject matter of physics and we are epistemically blind to whatever they may be.

Crucially, causal closure together with the causal exclusion argument renders the intrinsic properties explanatorily empty with regards to any state reducible to the language of physics, i.e. structure, dynamics, etc. As it turns out, our verbal reports about consciousness can be described by stimulated wave patterns on the air. In other words, these verbal reports can be described in the language of physics. Therefore, by causal closure, they are fully explained by prior events within the subject matter of physics. By causal exclusion, any intrinsic properties of the realizers of these physical events are excluded from explanatory relevance. There is simply no room for "non-abstract biochemical properties" to be explanatorily relevant to verbal reports about consciousness. But if verbal reports about consciousness are to actually be about consciousness, then consciousness must be explanatorily relevant to said verbal reports. Hence consciousness must be definable within the content of the subject matter of physics.

The only saving grace for biological theories are non-causal, metaphysical influences that are somehow relevant to verbal reports. Or epiphenomenalism where consciousness is actually irrelevant to all the things we say about consciousness. Both of these options are unintelligible; they are cures worse than the disease of functionalism. Some like to imagine some kind of emergence, such as "when physical structures take on specific forms, certain states of consciousness manifest". A simulation wouldn't take on this form in the real world and so a simulation wouldn't be conscious. But laws of this nature are absurdly adhoc and don't offer explanations, only brute laws.


You have this backwards. Thoughts and decisions precede consciousness, the sense of authorship is mostly constructed after the fact. See studies on readiness potentials in motor cortex.


If you're referring to the Libet experiments, they have been wildly overinterpreted. The conceptual problem with the common interpretation is that detecting a readiness potential prior to a report of a conscious intention to act does not entail the readiness potential is distinct from that conscious intention. The readiness potential may in part constitute one's conscious experience and so cannot be separated from it.


Even if overinterpreted were true, it's silly to claim that consciousness is driving. You don't "decide" to think thoughts. They come to you. They are driving.


One's subconscious drives much of your thoughts, yes. But important decisions are conscious mediated if only because consciousness has veto power. A lack of veto is a tacit endorsement of the action. That is control.


Either that or consciousness pops out afterwards as a by-product of the physical process. A less fun to believe idea I know, but the data supports it.


A digital simulation of an Enigma machine is not just abstract relationships. Its program is, but the program is not the simulation; the simulation is the program running on suitable hardware, which provides the causal element. Note that the hardware on which the program runs is very different from an Enigma machine's hardware, and the latter would be unable to run the simulation program. This is what is meant by substrate independence, a concept poorly understood by many philosophers-of-mind.

There are many differences between Enigma-machine simulation and nuclear-reactor simulation, but the one that is relevant here is that the former's inputs and outputs are abstract information, and we have very good reason to think that a brain's biological purpose (in the sense of what the organism needs it to do) is, like the Enigma machine's, abstract information processing in the broad sense.


We obviously will never agree since functionalism and my form of somewhat-physicalism are at complete odds. But I do want to understand your position more.

You say that the physical hardware your enigma simulation runs on provides the causal element. But the simulation of the nuclear reactor also runs on physical hardware. Yet it obviously doesn't provide the causal element, and neither does the enigma machine simulation's hardware. There are no spinning gears for example. Hence why you and I both call it a simulation, I think we're in agreement here.

I think you could argue that while the actual simulation of the enigma machine is not an actual enigma machine, the essence of the enigma machine is not grounded in physical reality, it's the abstract relationships we're talking about. And I could also agree. The essence of the enigma machine are it's abstract inputs and outputs.

But now about the brain. You said

> When you have digitally modeled a brain such that the model responds to its inputs as a brain does, then you have built a brain

The issue is that you have not built a brain, you have built a simulation of the abstract relationships of how a brain works. The brain is obviously more than that, considering it exists in physical reality. And thus the claim is that the essence of the brain is the abstract relationships, correct?

The problem I see is that consciousness is a physical phenomenon. In fact it seems like it's the magnum opus of phenomenon, in that all our experience comes from our consciousness. And you have to then bridge the gap between the simulation and physical reality. At most you can say you "simulated" consciousness, but questions about qualia remain.

Anyways I'm not trying to attack you or your views, I'd love to hear where I go wrong in your mind on this.


Let's start in the middle, where you say I wrote "When you have digitally modeled a brain such that the model responds to its inputs as a brain does, then you have built a brain."

What I actually wrote was this: "Then, presumably, you will also hold that when you have digitally modeled a brain such that the model responds to its inputs as a brain does, then you have built a brain." This has to be read in the context of the post by ratelimitsteve to which I was replying: I am not saying that I think that when you have digitally modeled a brain such that the model responds to its inputs as a brain does, then you have built a brain, I am saying it is something that ratelimitsteve would have difficulty denying while being consistent with his distinction between simulating and building. Personally, I would not say that simulating a brain to this extent amounts to building a brain, as that seems to me to be unnecessarily awkward usage that I feel will lead to confusion without making anything clearer. I would still call it a simulation, albeit one that might justifiably be called functionally isomorphic to a biological brain if it were good enough.

I would describe the relationship between an Enigma machine and a digital simulation of one in the same terms, and if I possessed an actual Enigma machine, I would not willingly swap it for a digital simulation!

With that said, let's go back to your second paragraph:

"You say that the physical hardware your enigma simulation runs on provides the causal element..."

Yes. The design of the physical Enigma device contains an abstract specification of how outputs are to be generated from inputs, such that when the machine is used, physics ensures that the correct output for any valid input is generated as a consequence of the causal relationships between its components. In the same way, the software of its digital simulator contains an abstract specification of how outputs are to be generated from inputs, such that when the program is run on a sufficiently capable computer, physics ensures that the correct output for any valid input is generated as a consequence of the causal relationships between its components, once the program has been loaded.

"...but the simulation of the nuclear reactor also runs on physical hardware. Yet it obviously doesn't provide the causal element..."

Correct, insofar as a computer is not capable of undergoing nuclear fission, regardless of how it is programmed.

"...and neither does the enigma machine simulation's hardware. There are no spinning gears for example."

No - these two cases are not equivalent. Nuclear fission is required for a nuclear reactor to function, but rotating gears are not required for encrypting or decrypting a message according to the enigma machine's abstract specification; they are just how the specification happens to be implemented in the machine.

"...Hence why you and I both call it a simulation, I think we're in agreement here."

Well, we both seem to be in agreement as to what to call it, but apparently not over why we think that.

In next paragraph ("I think you could argue that..") you say you could agree that the essence of the enigma machine is not grounded in physical reality, it's the abstract relationships we're talking about.

I am OK with that so long as it is understood that some sort of implementation is required for anything to happen.

Now we get to the misunderstanding of my reply to ratelimitsteve, covered above, and after that you go on to say "the claim is that the essence of the brain is the abstract relationships, correct?" My response to this is the same as with regard to the essence of an Enigma machine: I am OK with that so long as it is understood that some sort of implementation is required for anything to happen.

The next paragraph begins "The problem I see is that consciousness is a physical phenomenon...", and I tend to agree with the claim (though not that it is a problem) again in the sense that some sort of implementation seems to be required for anything to happen. I don't claim to be able to prove this, let alone explain how it works in brains, it just seems to me that there's no plausible alternative.

Then you write "In fact it seems like it's the magnum opus of phenomenon, in that all our experience comes from our consciousness..." To me, this appears to be a version of Cartesian doubt, about which I am extremely skeptical, in this sense: I think it is tendentious for anyone to invoke it only when it greases a sticky argument, while otherwise acting, speaking and arguing as if our sensory experiences give us reliable information about an external world.

Finally, we get to the crux of the matter: "you have to then bridge the gap between the simulation and physical reality." Here you just declare there to be a gap between the simulation and physical reality, but to my mind, nothing you have written up to this point provides any justification for thinking there is a gap that needs to be bridged. As best I can tell, you feel that by emphasizing the abstract nature of what you call the essence of a simulation you have divorced it from the physical, and my response to that has been, consistently, to point out that these abstractions do not get anything done unless they have some implementation, and there is no evidence of those implementations being in any sense non-physical.


Thanks for the reply. And I didn't mean to quote you out of context.

The reason I brought up the enigma machine's hardware is to illustrate there is a difference between the physical machine and the abstract program that it can be observed to implement. However the machine can be used for more than that, for example I could use it as a footrest, or I could dissemble it's parts and use it to build a bomb. I could simulate this as well, but nothing would actually get blown up.

Physical implementation alone does not show that every property of the simulated system has been instantiated. Reactor software is physical without fissioning nuclei, a simulated enigma can't be turned into a real bomb. What reason do we have to think consciousness is fixed entirely by functional/causal organisation, rather than depending on substrate-specific physical properties of brains? This is the gap I talked about, although rather clumsily I might add.

And reproducing the formal or input-output structure of a process does not automatically reproduce every intrinsic causal property of the thing simulated. If consciousness is intrinsic (and I think it is, my pain does not become pain only because an outside observer interprets my neurons as representing pain), then by contrast, a bit pattern in computer memory means “pain” because of how a program and its users interpret or employ it. It's problematic to explain an intrinsic phenomenon entirely in terms of observer-relative symbol manipulation rather than as a physical property, which the simulated brain would lack.


This is a follow-up to my previous reply, which may appear below this one. In that one, I forgot to say something about this: ‘…a bit pattern in computer memory [only] means “pain” because of how a program and its users interpret or employ it.’

This is somewhat begging the question, in that it tacitly presupposes that the system itself is incapable of interpreting it, but if the formation of this bit-pattern has certain consequences, such as the system saying it is in pain, redirecting its attention to finding any means to eliminate it while avoiding anything tending to exacerbate it, and forming memories which will have the consequence that the system will, from now on, try to avoid circumstances likely to cause its recurrence, then on what basis would you reject its own claims of being in pain?


I think there is an important distinction here that you are missing. The principle that a simulation is not the thing being simulated is true in general, but it cannot be used to justify the claim that there can be no equivalences between a simulation and the thing being simulated. Indeed, if this were the case, then the word 'simulation' would have no meaning, as it is precisely the existence of some equivalences that justify calling X a simulation of Y.

Furthermore, there is an important class of simulations that are important generally and very relevant here, and it is those where the equivalence is in the generation and transformation of information. When X simulates Y in this regard, and what matters (in whatever it is that makes Y interesting or important to us) is the information generated and/or transformed by it, then we can indeed substitute X for Y. So, in the Enigma machine example, would you argue that the output of a physical Enigma machine when it encodes a given text is not the same as the output from an equivalently set-up Enigma machine simulation encoding the same message?

As the text of the two outputs would be identical, I will assume you will allow that in this case, the simulation is performing the same function as the physical machine. Now suppose someone comes along and says "That can't be right! You can use the physical machine as a footrest, but not the simulation, so the Enigma simulation cannot substitute for the physical machine as a communications-security device."

Would you be persuaded that this argument is sound when applied in this case? If you think it is, then I do not think we can discuss this issue any further, but if not, then would you be any more persuaded by this argument: "That can't be right! A simulated rainstorm will not get you wet, so the Enigma simulation cannot substitute for the physical machine as a communications-security device?"

If you think the latter is sound while the latter is not, then I would be really interested in understanding why you would think that. If you think the latter is unsound, then you are in complete agreement with the whole point of my original post in this thread: arguments like "simulated rain does not get you wet" are useless against the simulation argument.

This does not establish that a sufficiently-accurate simulation of a brain could have a mind, of course, and while I think it would, I do not claim to know it would, and it would take more than the absence of conclusive proof in this matter to persuade me that it is implausible. In particular, I am familiar with all the widely-made arguments in that direction, and not only do I think they are defeasible, I think that the philosophical approach of "going metaphysical" is unlikely to succeed; if nothing else, we have been doing this for centuries, if not millennia, and nothing like a broad consensus has emerged from it (just look at the SEP Qualia entry [1], for example) - but that discussion goes far beyond what can be usefully debated in a website comments section.

[1] https://plato.stanford.edu/entries/qualia/


Ok I was implicitly including the mind as part of the brain. Absent a mind, I think we're just talking past each other. I don't see a reason why a brain absent a mind could not be simulated.

And of course I have nothing really novel to add to the arguments against a mind arising from a simulation, and I'm sure you're familiar with all the common ones.

However this is more interesting

" ‘…a bit pattern in computer memory [only] means “pain” because of how a program and its users interpret or employ it.’ This is somewhat begging the question, in that it tacitly presupposes that the system itself is incapable of interpreting it, but if the formation of this bit-pattern has certain consequences, such as the system saying it is in pain, redirecting its attention to finding any means to eliminate it while avoiding anything tending to exacerbate it, and forming memories which will have the consequence that the system will, from now on, try to avoid circumstances likely to cause its recurrence, then on what basis would you reject its own claims of being in pain?"

Are you claiming that the specific bit formations here indicate the presence of a mind?


Just to be clear, my objection to the "simulated rain won't get you wet" argument is not predicated on any assumptions about brains, minds, or the relationship between the two, and in my presentation of that objection in the chronologically first of my posts yesterday, I did not mention either and did not make any assumptions about their relationship.

In reply to your statement that you don't see a reason why a brain absent a mind could not be simulated, let's consider whether we could have a simulation of an Enigma machine that does not encrypt and decrypt messages.

It is possible in a trivial sense, of course: you could have a sort of cargo-cult simulation where the plug-board can be connected in various ways, the rotors turn when a key is pressed and one of the lights come on, but it lacks the causal relationships to produce output it could decrypt. This, however, is just an incomplete simulation, and the one that matters is this: could you completely digitally simulate the physics of an Enigma machine in a way that is incapable of being used to perform encrypted communication? If not, then there is something very wrong with what seems to be well-established physics.

Now let's suppose that we could do a complete-physics simulation of a person's brain. It will be missing many of the features of a brain (it will not consume material nutrients and produce waste products, for example), but how would you go about testing for whether it has a mind? How would an absence of a mind manifest itself? If you think the answer lies in the simulation not being part of a body, then let's suppose we simulate the person's whole body.

------

With regard to your concluding question, "Are you claiming that the specific bit formations here indicate the presence of a mind?", the short answer is no. I feel that with this question you are reverting to an earlier issue that we have already gone over: a digital simulation of anything is not just a pattern of bits, it is a physical process (i.e. a sequence of events.)


>If nuclear energy can’t arise from abstract relationships, why would consciousness or anything else?

because consciousness is a function of intangible relationships and energy is not.


And then the argument about Consciousness becomes whether it is strictly and completely necessary for the input to Output process.

There's also the question of input output range.


I'm not arguing one way or another on such issues; Here, I am just pointing out how irrelevant the "a simulated rainstorm does not get you wet" argument is, when presented as blocking the possibility of a brain simulation having a mind.


Are brains responsible for consciousness? Or are brains a tool that our consciousness uses to understand the world?


you might as well call consciousness a soul at this point.

something I once wondered about is what a soul can be and what implications it would have. the conclusions I drew is that the entire concept was incoherent. if a soul is so intrinsically linked to the brain (experience) such that it always goes along for the ride even into the abyss (eg. dementia) then it by itself wouldn't have any value even if it existed.


They seem to be. But that argument doesn't matter much because you can simulate the whole body. (If you want to argue consciousness is outside the body, I could get into the physics argument but instead I'll just claim that consciousness will attach to the computer too and if you have a reason it wouldn't it's your burden to say why.)


I don’t know where consciousness is but I think if we accept that you can simulate a brain exactly that doesn’t prove consciousness of a model as consciousness is a metaphysical concept really


This seems like a different topic from whether consciousness "uses" the brain?

But I will point out we don't have a way to prove anything is conscious, not even a human.


Consciousness appears to be a biological phenomenon, but so too are metabolism, reproduction and evolution. Are these also metaphysical concepts?


Consciousness does not appear to be biological, that is an opinion and a highly debated one


Where does it appear outside of biology?


Where does consciousness appear in biology? It’s a philosophical/metaphysical concept so far as I can tell


The one thing that I think all philosophers agree on is that the only confirmed cases of consciousness discovered so far are biological. They are divided over whether there is anything fundamentally more metaphysical about it than other biological phenomena (with Dennett having been the best-known dissenter, though he has many successors), and the debate has been going on without resolution for centuries, if not millennia.


“digitally modeled a brain such that the model responds to its inputs as a brain does”

If in responding to its inputs it experiences consciousness (=lights are on, experiences senses, perceives qualia), then you’ve built a brain. If your model simulates all the processing of a but does not have these then you have what’s fairly called a simulation of a brain. You can assert there is no such thing but good luck getting me to believe you.


> You can assert there is no such thing...

No such thing as what? As far as I can tell, I have asserted no such thing as there being no such thing, whatever it is.


“you will also hold that when you have digitally modeled a brain such that the model responds to its inputs as a brain does, then you have built a brain.”

What is this then?


What, then, is the thing that you allege I am asserting the nonexistence of in this sentence? Furthermore, this sentence does not state something I am asserting, it is something that ratelimitsteve would have difficulty denying while being consistent with his distinction between simulating and building (this is easier to see when you look at the entire sentence, including the two words that you left out.)

Update: I see ratelimitsteve agrees with that assertion.


That's the entire question, isn't it? IF you model a mind, have you just modeled it or actually built it?




Consider applying for YC's Winter 2027 batch! Applications are open till November 2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: