Refresh Data from Dynamics CRM

%3CLINGO-SUB%20id%3D%22lingo-sub-1740956%22%20slang%3D%22en-US%22%3ERefresh%20Data%20from%20Dynamics%20CRM%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1740956%22%20slang%3D%22en-US%22%3E%3CP%3EHello%20Everyone%2C%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EI%20have%20created%20a%20spreadsheet%20that%20displays%20data%20from%204%20tables%20within%20our%20Dynamics%20365%20CRM%20site.%20I%20have%20used%20merges%2C%20filtering%2C%20and%20column%20removal%20to%20consolidate%20the%204%20tables%20onto%201%20sheet.%20My%20issue%20now%20is%20every%20time%20I%20select%20%22Refresh%20All%22%2C%20it%20takes%20over%20an%20hour%20to%20re-load%20all%20of%20the%20data%20(about%20300%2C000%20records).%20I%20have%20tried%20using%20suggestions%20for%20other%20postings%20to%20speed%20up%20the%20load%20time%2C%20but%20haven't%20had%20any%20luck%20this%20far.%20Any%20input%20would%20be%20greatly%20appreciated.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E-Evan%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-1740956%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EDeveloper%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EExcel%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E%3CLINGO-SUB%20id%3D%22lingo-sub-1742547%22%20slang%3D%22en-US%22%3ERe%3A%20Refresh%20Data%20from%20Dynamics%20CRM%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1742547%22%20slang%3D%22en-US%22%3E%3CP%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F818376%22%20target%3D%22_blank%22%3E%40Eburdick42%3C%2FA%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EPerformance%20is%20never%20only%20technology%2C%20it's%20partly%20the%20art%20since%20for%20each%20concrete%20case%20it%20will%20be%20concrete%20solution.%20However%2C%20there%20are%20some%20recommendation%20to%20which%20is%20better%20to%20follow.%20Chris%20Webb%20had%20few%20series%20of%20post%20related%20to%20this%20topic%2C%20I'd%20recommend%20to%20check%20them.%20First%20I%20found%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CA%20href%3D%22https%3A%2F%2Fblog.crossjoin.co.uk%2F2020%2F06%2F07%2Foptimising-the-performance-of-power-query-merges-in-power-bi-part-3-table-join-and-sortmerge%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noopener%20noreferrer%20noopener%20noreferrer%22%3EOptimising%20The%20Performance%20Of%20Power%20Query%20Merges%20In%20Power%20BI%2C%20Part%203%3A%20Table.Join%20And%20SortMerge%3C%2FA%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CA%20href%3D%22https%3A%2F%2Fblog.crossjoin.co.uk%2F2019%2F08%2F18%2Fimmutability-and-power-query-performance%2F%22%20target%3D%22_self%22%20rel%3D%22nofollow%20noopener%20noreferrer%20noopener%20noreferrer%22%3ETables%2C%20Numbers%2C%20Immutability%20And%20Power%20Query%20Performance%3C%2FA%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3Eand%20more%20within.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E
Occasional Visitor

Hello Everyone, 

 

I have created a spreadsheet that displays data from 4 tables within our Dynamics 365 CRM site. I have used merges, filtering, and column removal to consolidate the 4 tables onto 1 sheet. My issue now is every time I select "Refresh All", it takes over an hour to re-load all of the data (about 300,000 records). I have tried using suggestions for other postings to speed up the load time, but haven't had any luck this far. Any input would be greatly appreciated.

 

-Evan

1 Reply
Highlighted

@Eburdick42 

Performance is never only technology, it's partly the art since for each concrete case it will be concrete solution. However, there are some recommendation to which is better to follow. Chris Webb had few series of post related to this topic, I'd recommend to check them. First I found 

Optimising The Performance Of Power Query Merges In Power BI, Part 3: Table.Join And SortMerge 

Tables, Numbers, Immutability And Power Query Performance 

and more within.