I work over SSH often from various other OSs, TUIs don't need any additional abstractions to make that work, I just SSH in from any computer/OS and everything works. All I need is SSH and the terminal based apps. It's not psychotic, it's literally a feature that cannot be found with GUIs.
hate to make a "me too" comment but TUIs working over ssh is what makes them so great. Also, when combined with something like screen it's icing on the cake.