Hey Jordantyj,
A Virtual Private Server is a virtual server, provisioned on a larger physical server. You run your own OS and can make any changes you want, without it affecting the host server, or other VPS's on the machine.
The benefit is much larger resources (depending upon the plan you choose), control, and security.
The downfall is there is still the single point of failure. If the VPS or the physical server goes down, your site is completely offline. Most reputable web hosts use things like RAID drives, dual power supplies, etc, but a failure can still happen.
Cloud computing is when your services are spread across several physical resources. This way if one piece of physical hardware fails, others will puck up the load and your services stay online.
A Private cloud marry's the two together so that you have the best of both worlds.
Benefit is, you can have almost 100% uptime of cloud computing, and the security/performance/control of a VPS.
There are still downfalls. If done correctly, this is a rather expensive option. A VPS gives you dedicated resources. A private cloud spreads those dedicated resources across multiple physical servers. This obviously ads to the price.
"Cloud" can also have different definitions depending upon who you ask. Some companies provide truly cloud services, others will have a VPS synced with another VPS behind a load balancer and call it cloud. Make sure you ask questions and are getting what you pay for!
IMHO, If I was looking for a High Availability solution to give high uptime, I would not go with a private cloud. Get 2+ VPS's from different providers, in different data centers, in geographically diverse location. Set roundrobin DNS or use a 3rd party DNS service that offers GSLB. This way, you have your site in multiple locations (protects against complete data center failure and can server your site from the closest DC) and are even protected in case your hosting provider goes out of business and shuts down over night.