You have to make your first payment via credit card so it's not anonymous unfortunately.

joepie91 maintains a list, but it looks like it's a couple of years out of date: http://cryto.net/~joepie91/bitcoinvps.html

Ah I did not know that; I inherited an account from a client. Thanks for that list.