if you are looking at previously owned stuff... Don't touch any of the third party memory cards. Look for official Sony 8MB MagicGate cards.
If you're looking for modern solutions, go with a MemCard PRO which should allow you to save your games to SD cards. Then you can backup the SD card wherever you want.