Excel could not get the source data for the PivotTable report from the disk

I have a spreadsheet with couple of pivots (around 7 pivots) and have a slicer connecting to all pivots on top. 

But when I open the excel the first time and try to click on something in the slicer, then I get the error - "Excel could not get the source data for the PivotTable report from the disk". If I click again I get the second error - "This PivotTable Report is invalid. Try refreshing the data (On the Options tab, click Refresh.)". 

If I do refresh all the data, the issue is fixed and the slicer works fine. But the error occurs every time I open the sheet. Any tips on how to fix this? Thanks!