You can keep your passwords only on a price of paper but that would mean a lot of typing. You keep them only in memory but that would make them guessable. You can keep them on a computer that doesn't run servers and is behind two firewalls (your PC). By keeping them on the PC you can have really long passwords.