Evolution affects humans too.

I present to you 5 facts.

1: Civilisation started after early homosapiens migrated from Africa into hostile ice age Europe.
2: Adaptions occur more frequently when an animal enters a new environment.
3: By far the most important adaption in recent human evolution is the brain. A neanderthal with a human brain would not be significantly worse or better off than a human.
4: Physical adaptions take longer to evolve than the simple increase in size of the neo-cortex.
5: Humans do have a plethora of physical adaptions to various environments.

That's a pretty big claim there. At the very least the unit subject to replication would have to influence the properties of its carrier (the way a gene affects the properties of its organism) but I'm pretty sure it doesn't end there.
The 'unit subject to replication' will evolve, it's pretty much a logical fact (Given imperfect replication and some sort of selective pressure, how can the replicator not evolve?). Memes replicate through communication, and this communication is imperfect, so they mutate. There is neither an infinite number of brains to occupy, nor infinite communication among them, so the resources are limited and a selection pressure arises.