On: The Era of 1-bit LLMs: ternary parameters for cost...

[trebligdivad]

Trinary however is an interesting middle; people have built trinary hardware long ago; it feels like you could make natively trinary hardware for something like this; it might even be quite a win.

[int_19h → trebligdivad]

People haven't built reliable ternary electronics, though. Soviets tried with Setun, but they eventually had to resort to emulating each trit with two hardware bits (and wasting one state out of the possible four).

[eru → int_19h]

If you are are using two bits anyway, you might as well represent (-2, -1, 0, 1) instead of ternary?

[int_19h → eru]

Sure, but then you lose the symmetry that makes trits so convenient for many things.

[thsksbd → trebligdivad]

Can you make a "CMOS" three voltage level circuit though? One where the only current flow is when the state changes?

Im not in this field but that's a question that's been bugging me for a while. Off you can't do this wouldn't energy consumption balloon?

[neomantra → thsksbd]

My friend was working on this in the mid-90s at Texas Instruments. Not sure what the underlying semiconductors were, but it did involve making ternary logic via voltage levels. Just searched a bit and found this TI datasheet which might be an example of it (high logic, low logic, high impedance), but maybe not: https://www.ti.com/lit/ds/symlink/sn74act534.pdf