Prejudice against speculative fiction

do you think that there is prejudice against fantasy and science fiction? (Fantasy, Science fiction etc')
If so, why? Is it justified?

The Sci-fi genre has some great writers, Philip K. Dick, Theodore Sturgeon, Roger Zelazny, Frederik Pohl, J.G. Ballard, Brian W. Aldiss, Larry Niven, Poul Anderson, Stanislev Lem, Poul Anderson, William Gibson... I could go on. Some of these authors have written some of the most thought provoking fiction ever put to paper. I don't think there is prejudice against Sci-Fi, although those awful book covers do not help, whereas I do think Fantasy has enourmous prejudice against it. While not a big fan (most of it seems like D&D shite for kids, which is a prejudiced opinion in itself) I have read a couple of good Fantasy novels and I quite enjoyed some of David Gemmel's Drenai books. And in some defence of Fantasy, Tolkien was not the be all and end all of Fantasy, The Lord Dunsany and E.R. Eddison were writing Tolkien style Fantasy long before he was, and much better I might add.