Nvidia drivers are a bit iffy sometimes, I will give you that. That said most major distros have builtin support and Arch has great docs for getting things going too.
Good question. I was having those types of issues and I recall issues with booting the usb stick via EFI too. I did install the latest Pop!_OS and it works last night so clearly better this time around!