I agree - I support the right of people I despise to express their views... Some people have a weird notion of free speech as absolute - I've seen people bitch about a university that didn't allow a well known racists to give a lecture - So what? Any entity can refuse your presence for any reason, in this case because it would ruin the university's policy, reputation and rules - Free speech doesn't mean people need to provide you a megaphone and listen to you all day, nor does it mean consequences from your words' actions - If you speak out something highly objectionable and suffer social consequences like unemployment and marginalization, it's not society's fault and it's not an infringement on free speech.
Whoever fights monsters should see to it that in the process he does not become a monster. And if you gaze long enough into an abyss, the abyss will gaze back into you