PowerQuery (Data from the WEB) Error: The data in the preview has been cut due to size limitations"

%3CLINGO-SUB%20id%3D%22lingo-sub-2447549%22%20slang%3D%22en-US%22%3EPowerQuery%20(Data%20from%20the%20WEB)%20Error%3A%20The%20data%20in%20the%20preview%20has%20been%20cut%20due%20to%20size%20limitations%22%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2447549%22%20slang%3D%22en-US%22%3E%3CP%3EI%20want%20to%20import%20data%20from%20the%20Web%20(%3CA%20href%3D%22https%3A%2F%2Fde.finance.yahoo.com%2Fquote%2FSEAC.DE%2Fhistory%3Fperiod1%3D1518566400%26amp%3Bperiod2%3D1623715200%26amp%3Binterval%3D1d%26amp%3Bfilter%3Dhistory%26amp%3Bfrequency%3D1d%26amp%3BincludeAdjustedClose%3Dtrue%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3Ehttps%3A%2F%2Fde.finance.yahoo.com%2Fquote%2FSEAC.DE%2Fhistory%3Fperiod1%3D1518566400%26amp%3Bperiod2%3D1623715200%26amp%3Binterval%3D1d%26amp%3Bfilter%3Dhistory%26amp%3Bfrequency%3D1d%26amp%3BincludeAdjustedClose%3Dtrue%3C%2FA%3E)%20via%20PowerQuery%20in%20order%20to%20work%20with%20the%20historical%20data.%3CBR%20%2F%3ESadly%2C%20whenever%20i%20try%20to%20import%20the%20data%2C%20PowerQuery%20cuts%20my%20Data%20down%20to%20100%20rows.%20However%2C%20I%20need%20the%20whole%20data%20set.%3CBR%20%2F%3EDownloading%20the%20Data%20as%20CSV-file%20from%20the%20website%20is%20not%20a%20possibilty%20as%20I%20want%20to%20be%20able%20to%20refresh%20the%20data%20easily.%3CBR%20%2F%3ECan%20anyone%20help%20me%20with%20this%20problem%20and%20give%20me%20a%20solution%20of%20how%20to%20import%20all%20the%20data%2C%20while%20being%20able%20to%20refresh%20it%20easily%3F%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-2447549%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EBI%20%26amp%3B%20Data%20Analysis%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EExcel%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Occasional Visitor

I want to import data from the Web (https://de.finance.yahoo.com/quote/SEAC.DE/history?period1=1518566400&period2=1623715200&interval=1d...) via PowerQuery in order to work with the historical data.
Sadly, whenever i try to import the data, PowerQuery cuts my Data down to 100 rows. However, I need the whole data set.
Downloading the Data as CSV-file from the website is not a possibilty as I want to be able to refresh the data easily.
Can anyone help me with this problem and give me a solution of how to import all the data, while being able to refresh it easily?

1 Reply

@Keiler2002 

As variant you may create in Excel table like

image.png

with 100 days periods staring from TODAY() for the first Date2. Convert dates to Unix Time format (you may google how to do that), query this table. In Power Query create the function which takes data from the site (Period1, Period2 as parameters, but you may add other ones).  In PQ add custom column which returns results from the site, remove all other columns, combine this one and return result back to Excel.

100 rows limit most probably added intentionally on server site, java script recognizes who makes the query. Another possible limits could be limit on number of refreshes after first few ones, or time limit between refreshes. Thus such workarounds are not very reliable. Plus limitations could be changed any day and you need to find another workaround. People pushes you to purchase reliable service.