Human rights are man-made and arbitrary. They aren't some kind of holy text that must be protected at all costs. They must be bent and ignored if necessary. You can't just say "this is a human right" to shut down any discussion.
Thats true if we assume that every human want the same thing. But the reason there is bloody fight in the first place is not all human want the same thing. Is good for you if you are in the winning side, you certainly don't want to lose them but you can't say the same for the other side. They too want to be on the winning side.
Obviously since there is no God then yeah they are "made-up", but their value is obvious. Governments have a tendency to want more and more power, and by governments I mean the ones in charge like Xi, KJI, and Hitler. Those sorts do not like human rights and think they know better than everyone what is best, especially if it makes them richer and more powerful. This is why human rights are important and why they shouldn't be compromised for "safety" because you might get a little safety in the short term, but tomorrow brings genocide.