Mostly just integer factorisation of large numbers is hard.

There are some other things you have to worry about practically, e.g Coppersmith's attack, and padding schemes (although that wasn't part of the proof I was given)