I think of cultural appropriation a lot like pronouns.
If someone says, "use she/her," then you do that. Easy peasy.
If people from a living tradition say "hey, that's appropriation, don't do that," then you shut up and stop doing that. It's real simple. If you're not living that experience, it's not your decision to make.
