Prevent user with delegation access to open an e,mail Protected with AIP

Also wanting this, seems to be a big gap where Information Protection Labels for emails aren't secured by checking the logged on user, but instead checking the mailbox accessing it and granting it that way.