I feel that it can often help that foreigners (especially Americans) have a reputation for rudeness that has become accepted as “cultural difference”, such that people are not as offended when a gaijin does something that would be considered offensive coming from a Japanese person.