Free speech is not what you think it is. Free speech means the government won't stop you from speaking. It doesn't mean you are allowed to say anything you want. You need to go back to middle school civics.

https://en.wikipedia.org/wiki/Paradox_of_tolerance

If there is no limit to tolerance, the intolerant will abuse that and we end up with an intolerant society. Tolerance is a social contract. If you break it, you are no longer tolerated.

The ONLY exception to this is if the language is used to directly harm, then it is no longer language, it is a weapon and should definitely be restricted.

Cool. Then stop using that word. It is directly harmful to some people.