There was this recent improvement at least: https://phoronix.com/scan.php?page=news_item&px=Linux-5.14-A...
edit: seems there are some howtos - eg https://github.com/joeknock90/Single-GPU-Passthrough
1. Desktop environment, which uses the video card; this is not a big deal, since one can terminate the session
2. video drivers correctly and fully releasing the card; this is possible, but in my opinion, not stable.
the host never sees the card.