Sharepoint 2016 Farm 403 Forbidden Error and Refreshing Page or Clear cache will solve the issue

Sharepoint 2016 Farm 403 Forbidden Error and Refreshing Page or Clear cache will solve the issue.Its quite frequent for the user. We are using ADFS Server as a middle one for authentication.

There is no error mentioned for the problem facing Users neither in ADFS Nor In Sharepoint 2016

Kindly help us to solve the issue.