Document Sets not filtering into folders

We have SharePoint 2019 and when we have documents in folders with common meta data, when we filter on the top folder is not crawling the sub folders to find all files with the metadata set to "Yes".  Any advice?