GPU-P not supported in Windows Server 2022 NV4

Tried to search for a solution but it seems GPU-P is not supported for Windows Server 2022 at the moment. Rolling out Graphical VM's (N-series) with https://docs.microsoft.com/da-dk/azure/virtual-machines/windows/n-series-amd-driver-setup is not an option right now. The Graphic card isn't used by DirectX and you also don't see the GPU back in your task manager.

The Graphic card is installed but not used in DirectX. If we do this in Windows Server 2019 everything is working nicely. 

Hopefully somebody at Microsoft can tell if a fix is coming soon for this. We need the graphic card for our applications.