Forum Discussion
Aread62127
Jan 10, 2021Copper Contributor
Need help with large data sets
Hi all wondering if someone can help me with a solution! We have 10+ suppliers that send us multiple excel spreadsheets on a monthly basis with millions of lines of data. The data unfortunately doe...
Riny_van_Eekelen
Jan 10, 2021Platinum Contributor
Aread62127 Have a look at PowerQuery (PQ). It allows you to connect to data sources without loading everything into Excel. Since you ask the question, I assume that you are not familiar with it. Perhaps wise to have a look at the information in the attached link. Then you will get an idea of what PQ can do.
- Aread62127Jan 10, 2021Copper ContributorThanks for the reply
Can I ask though, when I create a query and then want to present the results or produce a pivot etc, if the results are 1m+ lines will this cause an issue for excel?- Riny_van_EekelenJan 10, 2021Platinum Contributor
Aread62127 No problem, you can load the data into the Data Model. More about that in, for example, the link below: