How long has the web host been in business? Have they changed management/ ownership in that time or, more importantly, recently?
I prefer to choose time-tested web hosts: Lusovps.com, Microvps.com Libertyvps.net
Touching on the point above, the first thing that needs to be determined is your individual needs and what you are looking to accomplish.