This is really bad, 3 people shouldn't be able to use freedesktop's name to push their own agendas on a developer not even affiliated with any of their project.
lyude sounds like the type of person that goes insane the moment they get a whiff of power even if that power is something as unimportant as "FreeDesktop CoC board".
We went to Software Freedom to "develop the software the way we want you to".
Of course there is nothing wrong with not wanting to associate with specific people. Frankly for any reason.
However Vaxry changed the rules of his community and follows the Freedesktop guidelines when he himself communicates with people at freedesktop.org