Tolerance is a peace treaty between society's sub-groups. When one group breaks that treaty it's moral and necessary to respond in kind and not tolerate them.
If a country rolls tanks into your country it's not immoral to respond in kind to defend yourself. Same idea applies to intolerance.