The whole "cultural appropriation" thing is, essentially, an assertion that there's some kind of implicit intellectual property like relationship that one has with one's culture and its collective experiences. So when you need to "use" a culture that's "not yours", you have to ask for permission, and conform to the rules that the other party frames their grant of such around.