On Fedora, the apache webserver is called httpd. httpd is already installed in this VPS. To configure it to start at boot time:
chkconfig --levels 235 httpd on
… and start Apache:
/etc/init.d/httpd start