There are various cheap and reliable VPS Hosting plans but it's not necessary they are fulfilling your requirements.
You need to identify your needs and requirements first and then lookout for an ideal hosting provider.
Analyze an approximate amount of traffic you will be encounter in the future, identify your bandwidth, RAM, and Hard Disk requirement. Also, see the kind of data you will be stored on your server and the level of security you will need.
Consider all these then find out a hosting provider in your budget.