Sensitivity Label error message shown on library where sensitivity label should not be applied

Hi Team,   I am facing issues with sensitivity labels. We have sensitivity label configured for specific Sharepoint Library . We have other libraries as well where this label should not be applied...