Forum Discussion
Excel Power Query Wont Load All Rows
YWolf970 Thank you, not necessary if you are sure. Your query is connection only or with loading to data model?
SergeiBaklan Its connection only and I am not loading to data model. I have another file that has about 500k records and I want to do inner join and load data to table.
Attached below screenshot with last active line. I have also added link to the master file in the question.
So far so good, thanks for sharing. Bit strange for me, will try to play with that some later.
SergeiBaklan I have, I have also tried by increasing virtual memory.
Good News is that I have found the cause of the problem. Apparently its the m-code or you can say the fixed length definition I am using. If I remove it and import data as 1 column then it counts correct number of rows, screenshot is attached.
Here is the code, if I remove it then Power Query counts correct rows, It will be a big help if we can fix it as I need the coumns defined by length.
let Source = Csv.Document(File.Contents("C:\Users\Ali\Desktop\New folder\TaxRoll20200925\Master.dat"),41,{0, 11, 30, 33, 35, 65, 95, 125, 155, 168, 198, 223, 230, 236, 242, 246, 256, 286, 306, 326, 356, 386, 416, 446, 476, 496, 514, 524, 534, 540, 546, 556, 571, 581, 611, 626, 637, 648, 660, 672, 684, 699, 729, 739},ExtraValues.Ignore,20127) in SourceThank you for the screenshot. I tried to play with about 2M rows text file, but with only couple of columns - PQ loads everything, into data model as well.
Thus that's not just number of rows, some combination. Did you try to clean the cache in PQ?