Moreover, the Maghreb, the Levant and Asia Minor (North Africa, East Mediterranean coastal countries and Turkey today) were inarguably "Western" (Roman, Greek, Phoenician and Judean) before the Arab and Turkic invasions.
Bantu peoples were sold as slaves for millennia, until late into the 20th century, from the east coast of Africa by Somalis to Arabs and Indians. Muslim Barbary piracy (from the Tunisian and Moroccan coast) terrorized and devastated European coastal towns for centuries. There are entire extinct populations from the Baltic region who were literally sold down the Volga River to Muslim Turks and on into the Middle East, who were particularly valued for their blond hair and pale skin. There are surviving populations of pale people (whom most Americans would classify as "White") still suffering from the effects of their ancestors having suffered genocide and slavery, some at the hands of slavers who would be considered "People of Color" today.
No. The idea of slavery and genocide being a sin, of being morally wrong, is a recent Western idea that is not even today a universal, global cultural value. If "sins of the Father" is actually a thing, then it spectacularly makes no sense to divide the world into "White" (descendants of slavers and colonizers) and "People of Color" (descendant of slaves and colonized).
While such a division might arguably be a reasonable case to make given specifically US History, attempting to impose this racial world view on other cultures and nations is yet another example of the very American cultural imperialism that these same people decry.