Can't RDP when in protected users group 2 domains no trust

I have the following issue and have read a lot about people with similar issues, but not quite the same setup as we have.

We are working with 2 domains. I call them Domain A and B.

So Domain A is our own domain, with our own DC and servers. Domain B is a shared setup for our customers.

We all are working with our mailto:email address removed for privacy reasons accounts to gain access to servers from our customers.

All customer servers are member of Domain B

All admin accounts are members of protected users.

When i am logged in to our management server, that is a member of domain A i cannot RDP with my mailto:email address removed for privacy reasons account to whatever server from our customers.

When i am in the office, we can access domain B from our personal laptops who are only Entra ID joined. From our personal laptops we can RDP to the servers of the customers in Domain B with the mailto:email address removed for privacy reasons accounts.

Strange thing is:

not all admin accounts have this issue (at the same time)

Issue is resolved spontaniously

My first question is, do i need to have a domain trust between Domain A and Domain B

Both the domains have higher domain functional level then 2012 R2.

I have communication between my management machine in Domain A to the domain controllers of Domain B. Not only ping, but also KDC, DNS, LDAP, etc.

Our domain controller in Domain A does not have communication to Domain B.