It states on the blog that WVD does not require outbound internet access in order to function:
"Virtual machines in Windows Virtual Desktop are not exposed to the Internet directly. They can run using a private IP address and run isolated from other workloads or even the Internet. (The reverse connect technology allows the VMs to be accessed.)"
However I've just denied all outbound connections to the internet and this has broken the VM.