Office 365 groups Shared with us functionality

I think it's an awesome feature, but if a file is unshared or even deleted it still shows in the list and gives an access denied when it's click on. Is this a common problem? I tried reindexing both ...