Using ADFS to restrict endpoint access to WVD Environment

Apologies if this was brought up somewhere else but I haven't found anything on this specific subject.

We are undergoing PCI certification in our Azure WVD environment.  We are currently using a physical USB device for endpoint management and want to use an Access Control Policy in ADFS to limit access from unauthorized endpoints.  However, we still want to allow access to Office 365 and other Azure resources from a broader spectrum of devices.  Right now, we have a single Relying Party Trust covering all ADFS authentication through Microsoft.

Is there a way to create a separate RPT to cover just WVD so we can apply a corresponding ACP to?

We want to stop short of full on device registration at this time, though that may be the best overall choice.

Appreciate any ideas to get us in the right direction!