Every political group attracts a few crackpots, but no group attracts as high a percentage of crackpots as groups with unpopular opinions. Outcasts are drawn to fringe groups — and fringe groups have little enough support that they don’t want to alienate any potential supporters.
I’ve been aware for a long time that libertarian and some conservative groups attract crazy people. Many times, these crazy people are highly intelligent, very weird and often obsessed with something strange. Those folks aren’t generally going to be accepted among the mainstream parties, because those groups have plenty of support and it’s easy to edge the weirdos out. But fringe groups accept the weirdos more readily.
And why not? One of the core libertarian beliefs is that people have the right to be whatever they want to be. If somebody’s life centers around promoting drinking colloidal silver to cure every ailment under the sun — or trying to communicate with aliens or researching conspiracies about how the Bilderbergers rule the world — hey, that’s his business, even if he’s nuts. As long as he agrees with us that other people have the right to believe and act as they choose, he’s welcome in the “liberty tent.”

Galt’s Gulch? I can live without that, but I need my own ‘Akston’s diner’
What are the odds that gambling improves your economic future?
National sugar daddy? Warren Buffet wants to give us money … sorta
Market failure? Why do we have so many overeducated people?
Without growth on similar paths, two people drift apart, love dies
Time to face facts: Most people don’t really want individual liberty