How does cache work?

I mean, from the perspective of the program at hand. Is it just a bunch variables that you load data too from your DB or what?

I know there are libraries like memcached that take care of this. How do they cache stuff?