Good news everyone!
PHP 7.4 is finally released, even for Windows users like me! You can download the files HERE!
Please do keep in mind that the developers at PHP.NET use Visual Studio 2019 to compile these files, so make sure you have the latest Microsoft Visual C++ Redistributable installed. If not, you can find the nessecary files here.
Watch out though, if you use WordPress (like I do), the administrative pages (wp-admin by default) don’t seem to work. Keep this in mind in case you are thinking about upgrading.