First things first. Are you talking about *nix flavored web
hosting or Windows. In either case, you should study up
on either linux or IIS as there is MUCH MORE to hosting than
simply setting up a VPS...
The website hosting industry is completely inundated right
now, so I'm not sure why you chose this avenue, however,
to each his own, you have every right to do whatever you
want, however, if you are completely green to hosting, I'd
strongly suggest you get set up with a low cost dedicated
server (with MANAGED services) so you can play around
with the technical stuff to get your feet wet...
Make sure it's "managed" so that when you mess something
up, and if you're real new to this, you WILL mess things up,
you can simply have the server reset back to default config
by the actual server company.
Suffice it to say, there really is SO much to learn that a mere
post on this forum will not help you in the slightest.