On: Building a Raspberry Pi 3B+ full keyboard handheld

[5-]

By "program directly from the framebuffer" do you mean that you can't use X11 key remapping facilities?

In that case, loadkeys(1) will help (on linux).