XAMPP is a package that installs Apache, MariaDB, PHP and Perl onto Windows, Linux or Mac. It is a very simple way to get a web development environment up and running with little knowledge.
VPS , Virtual Private Servers, are simply virtual servers that are hosted by vendors such as Linode and Digital Ocean.
Apache is the go to web server for deploying websites. You can run it on Linux, Windows, Mac, Unix and more. It’s free, and reliable.