Apply Label disappears in details pane in SharePoint after Library Label is applied

My company is running into a hassle individually applying labels to documents with already applied library labels. How we have setup our sites, is to have certain document libraries apply a default library label. Once a document has been applied a default label through the library, the Apply Label field in the Details Pane for the document disappears, and only shows the Name and Title fields. This means, every document within needs to be opened through Compliance Details, to open a new page for Label Status to apply a label to individually label a document in a library. Has anyone else noticed that, or know how to get around this?