the fact is that there is nothing free about banning religious buildings. if 4chan was banned for being abhorrent morally, and for being a rallying point for hackers and trolls, you would be outraged, but because you aren't a muslim you see this as free.
admittedly there's no theological value to minarets, but there's no theological value to church steeples- should we ban them too? why not?