When running in Windows Server 2016, should i block all the incoming connections in firewall setting

i'm running a Windows server 2016 system on a virtual private server(VPS) that i can access throught remote desktop.I'm also going to host a website, so i want the best possible windows firewall settings as possible.I know i must keep the incoming http,https,remote desktop connection(80,443,3389). My question is,should i block all the rest incoming connections from the firewall settings?