Apr 10 2019 05:27 PM
I am using query editor in excel to pull raw data from multiple files within a folder that contains day to day data in it. I am experiencing a lengthy waiting period when refreshing the query, and each day the waiting time increases as it searching through more and more files.
Is there a setting that can be applied, or an approach to tell the query editor to only look for new files, as the previously loaded files will not change as they will be historical data. This way the refresh times will be fast as it will only be looking for a days or 2 days worth of data, rather than 3 months worth, or by the end of year, 12 months worth..
Dec 16 2019 06:59 AM
@cchiappazzo could you solve this? I have the same problem. Regards
Dec 16 2019 07:08 AM
I guess incremental refresh works only in Power BI Premium, not in Excel.
Aug 16 2020 04:21 PM
I was just researching this question. As you apparently know, there is a dedicated feature in PowerBI for incremental refresh.
.
There is not a similar feature in Excel PowerQuery. But I did find a couple of articles that suggest manual work arounds
Incremental data loads in Microsoft Power Query for Excel (DIY incremental) 2015 05 15
https://www.oraylis.de/blog/incremental-data-loads-in-microsoft-power-query-for-excel
How to create a Load History or Load Log in Power Query or Power BI 2016 11 19
https://www.thebiccountant.com/2016/02/09/how-to-create-a-load-history-or-load-log-in-power-query-or...
Aug 19 2020 12:41 PM
IMHO, that's more about incremental data appending, not about incremental refresh
Jun 25 2021 06:46 AM
In the interest of keeping the solution with the question in case those websites are no longer accessible, the basic premise of incremental updates in the Excel for Windows version of Power Query is as follows:
If you are using Excel for Mac, while it now supports refreshing PQs and creating PQs using VBA, you’ll find it’s a whole lot easier to build a PQ with the Windows version of Excel. Good reason for even the most die-hard Apple fan-boy to keep a Windows laptop or PC around, even if it’s a cheap $200 netbook or a small VM, as long as it can run Office.