I also want to point out the circular logic you have going on. It’s a slur because it’s considered one, so it’s only use is as a slur, as a result, it only gets used as a slur, so it’s considered a slur, so it only ever gets used as one.
Yes, that’s exactly how language works. The meaning of words is determined by usage.