i'm using Linux just fine on an ARM desktop for a long time, via Apple Silicon hypervisor enabled via the UTM macos app (which wraps both Qemu, which i don't use, and Apple Silicon hypervisor, which i do use, configurable when instantiating a new image from an iso).
i mention this because perhaps you'd like it too. in my case fedora 43 works just fine, and fast.
i used the UTM app from the App Store, and when creating a new instance, i select the Linux icon, which exposes the selection to enable Apple Silicon hypervisor rather than Qemu. it works perfectly. and it's fast. just great. I had used Asahi before, dual booting, which was a pain in the neck. this meanwhile is perfect.
i mention this because perhaps you'd like it too. in my case fedora 43 works just fine, and fast.