Every political group attracts a few crackpots, but no group attracts as high a percentage of crackpots as groups with unpopular opinions. Outcasts are drawn to fringe groups — and fringe groups have little enough support that they don’t want to alienate any potential supporters.
I’ve been aware for a long time that libertarian and some conservative groups attract crazy people. Many times, these crazy people are highly intelligent, very weird and often obsessed with something strange. Those folks aren’t generally going to be accepted among the mainstream parties, because those groups have plenty of support and it’s easy to edge the weirdos out. But fringe groups accept the weirdos more readily.
And why not? One of the core libertarian beliefs is that people have the right to be whatever they want to be. If somebody’s life centers around promoting drinking colloidal silver to cure every ailment under the sun — or trying to communicate with aliens or researching conspiracies about how the Bilderbergers rule the world — hey, that’s his business, even if he’s nuts. As long as he agrees with us that other people have the right to believe and act as they choose, he’s welcome in the “liberty tent.”

Intolerance isn’t just an American thing; it’s common to all humans
Marriage is a business decision, not just matter of romantic love
Is it abuse to force atypical kids to conform to norms of society?
Why can we sabotage ourselves?
Sabans remind me that choice of partner can be a key to success
NOTEBOOK: The forest is burning, so quit arguing about single trees
When it comes to politics and race, double standards are everywhere