Prejudice against speculative fiction

do you think that there is prejudice against fantasy and science fiction? (Fantasy, Science fiction etc')
If so, why? Is it justified?

Nobody's even mentioned Asimov. I'm not a big fan, but his influence on technological society is undeniable.