There is no requirement that information has a physical representation for information-theoretic entropy. Landauer's result assumes that it does have a physical representation, and derives some physical consequences.
A simple example where information-theoretic entropy is used where there is no physical representation: Video codecs.
I'm guessing you've heard of mpeg and h.264 encoding. Which one encodes a movie better? One way of answering this question is to ask: Which codec added less entropy (perhaps for the same compression)?
For that matter: Before Shannon's information entropy, one might wonder if there is a way (another codec) perhaps recovering the information after mpeg coding and decoding. However, now you know that information-entropy can only increase or stay the same, which tells you that subsequent "correction codec" cannot remove entropy introduced by mpeg codec.
Thanks. I don't really like that example with codecs, because I could always argue that any codec can only be a physical system, operating in some environment at temperature T and will be constrained by Landauer's, ets.
Either way, I think we've digressed. I'm actually very happy with yours: "Adding energy to a system with negative temperature reduces the number of microstates.", because this is clear and unambiguous.
I think his argument, is that I have no right to talk about bits [edit: in the context of stat mech], before defining physical representation of these bits - that is a physical system, states and transitions between states.
> is that I have no right to talk about bits, before defining physical representation of these bits
I'm saying something slightly different: You can talk about bits in a system without a physical representation; That system can have an information-entropy associated with it. Once you implement a physical system representing those bits, then Landauer's comment applies.
There is no requirement that information has a physical representation for information-theoretic entropy. Landauer's result assumes that it does have a physical representation, and derives some physical consequences.