It's more complicated than that, same as PAGING on Windows. It's about offloading some of the less accessed data from RAM onto slower hardware.

You can compress the swap, so you can squezze a bit more by using CPU in that tiny amount of read you do.