How are Jews not white?

I can understand white supremacists hating people of different skin tones, but how are Jews different than whites?  It seems to be more of a cultural hatred than a color based hatred.  I consider Jews as white people the same way Russians, Germans, Polish or French would be classified as white.

Actually it's sort of a pyramid thing. Blonde nordic protestnats at the top, black haired, but still white with western values the next step down, mediteraneans, catholics eastern europeans the next step down etc etc..