On CentOs, this is quite easy --
$ sudo yum install php-pecl-apc
(That's the PHP Extension Community Library implementation of the Alternative PHP Cache)
Then install the APC backend plugin:
Note the out-of-the-ordinary installation on that plugin (place a file in the wp-content directory).
Sit back and watch your server load drop!