Exclude sensitive labelled document from Microsoft 365 copilot lookup

Hi,

In my organization i have AIP labels which is used only for classification not for protection. while implementing copilot, is it possible to exclude copilot access to sensitive labelled documents while looking up based on user prompt. Thanks.