The problem I see is bigots using that as cover for their bigotry. “Sorry, this golf club is a safe space for people triggered by black people and women.”
The government would have to decide that the discrimination we like is ok, but the discrimination we don’t like isn’t. Which has incredible potential for abuse when the wrong people end up in charge.