I was getting a bit annoyed configuring so many boxes and having to retype passwords a million times I decided to import my public RSA key and be done with it.
Here is a quick how to so you can do the same :

On the Client (the box you will be using to connect)

$ ssh-keygen -t dsa -f ~/.ssh/id_dsa -P ''

On the Server (copy ~/.ssh/id_dsa.pub to this machine)

$ cat id_dsa.pub >> ~/.ssh/authorized_keys
$ chmod 600 ~/.ssh/authorized_keys

Back on the Client

$ ssh -i ~/.ssh/id_dsa root@<hostname>

Where hostname is the SSH server.
You may be asked to put in your password one last time, I do not believe I had to myself.
Now you can just ssh <username>@<hostname> and voila, you are in!

You can imagine how much time this saves me whilst administering ~ 10 boxes.