Forum Discussion

Jsanta07's avatar
Jsanta07
Copper Contributor
Sep 06, 2021
Solved

Why power query consumes all my resources?

Hello all!! I'm having a problem using power query: i have 12 .CSV files in a folder, i import them using the folder load capabilities, but, when i try to do more operations in the query (merging, ...
  • SergeiBaklan's avatar
    Sep 07, 2021

    Jsanta07 

    If you use modular approach that could help. Use separate query/queries to load data, another query to merge (one for each merging), another to combine, etc. Grouping could be critical for the performance, check if it could be optimized. Remove unnecessary columns on early stages.

     

    SQL connector in general faster and perhaps query folding works in this case, that means transformations are done on the server.

Resources