There actually is no paradox if you think of this way:
Be tolerant of ideas that harm nobody.
Be intolerant of ideas that harm others.
"I'm gay." <- Tolerable.
"I'm not gay, so I won't date men." <- Tolerable.
"I'm not gay, so I think we should kill all gay people." <- Intolerable.