Every political group attracts a few crackpots, but no group attracts as high a percentage of crackpots as groups with unpopular opinions. Outcasts are drawn to fringe groups — and fringe groups have little enough support that they don’t want to alienate any potential supporters.
I’ve been aware for a long time that libertarian and some conservative groups attract crazy people. Many times, these crazy people are highly intelligent, very weird and often obsessed with something strange. Those folks aren’t generally going to be accepted among the mainstream parties, because those groups have plenty of support and it’s easy to edge the weirdos out. But fringe groups accept the weirdos more readily.
And why not? One of the core libertarian beliefs is that people have the right to be whatever they want to be. If somebody’s life centers around promoting drinking colloidal silver to cure every ailment under the sun — or trying to communicate with aliens or researching conspiracies about how the Bilderbergers rule the world — hey, that’s his business, even if he’s nuts. As long as he agrees with us that other people have the right to believe and act as they choose, he’s welcome in the “liberty tent.”

Without motivation, dreams fade,
Why are killing, maiming people elsewhere called moral, ‘legal’?
‘Thanks for sharing your process’ is wiser than responding in anger
Sad husband: ‘My beautiful wife is dying; I’m so sad I can’t sleep’
Is ‘majority rule’ moral even when the majority don’t want freedom?
‘Free money for everybody’? Is it smart for principled libertarians?
Hiding anger was a survival skill, so you might not know I’m angry
Instinctive desire to ‘do something’ almost always leads to bad policy
Advice to fast food restaurant execs: stop ‘innovating,’ do the basics right