I think you'll find that even in those "community oriented" cultures, many people don't like random strangers taking photographs of them, although unlike Westerners they may not be as forthcoming about it, especially to a foreigner.
Yeah that's the thing, I don't find that. There are plenty of locals who shoot all over Asia for example and do just fine. I think maybe you're projecting.
