How to select caller ID from teams?

I have setup a call queue and added two agents. These agents are unable to change their caller ID to the calling ID (I have this assigned under the Assign calling ID section in the call queue and within the Caller ID Policy). By default it is still showing their assigned phone numbers and there is no clear way to change and the policy does not appear to be forcing it to use the Call Queue ID as requested in the policy.

Is there something obvious I am missing?