incremental refresh in query editor

Highlighted
Occasional Visitor

I am using query editor in excel to pull raw data from multiple files within a folder that contains day to day data in it. I am experiencing a lengthy waiting period when refreshing the query, and each day the waiting time increases as it searching through more and more files.

 

Is there a setting that can be applied, or an approach to tell the query editor to only look for new files, as the previously loaded files will not change as they will be historical data. This way the refresh times will be fast as it will only be looking for a days or 2 days worth of data, rather than 3 months worth, or by the end of year, 12 months worth..

4 Replies
Highlighted

@cchiappazzo could you solve this? I have the same problem. Regards

Highlighted

@hwoe1 

I guess incremental refresh works only in Power BI Premium, not in Excel.

Highlighted

@cchiappazzo 

I was just researching this question. As you apparently know, there is a dedicated feature in PowerBI for incremental refresh.

.

There is not a similar feature in Excel PowerQuery.  But I did find a couple of articles that suggest manual work arounds

Incremental data loads in Microsoft Power Query for Excel (DIY incremental) 2015 05 15
https://www.oraylis.de/blog/incremental-data-loads-in-microsoft-power-query-for-excel

How to create a Load History or Load Log in Power Query or Power BI      2016 11 19
https://www.thebiccountant.com/2016/02/09/how-to-create-a-load-history-or-load-log-in-power-query-or...

Highlighted

@ron S. 

IMHO, that's more about incremental data appending, not about incremental refresh