SharePoint Online - Restricted View - Sorry, you don't have access.

Hi, We have SharePoint Online sites in which we have documents and having multiple folders. We are facing an issue that we give "Restricted View" Permission to one user on a folder to only read file...