Dec 11 2019 07:09 AM
I am trying to create some PowerBI reports for my customer (no, I cannot use workbooks) and in order to get some good charts I need to be able to import a large number (1M+) number of rows but it seems that I get only about 100K at most. Does anyone know if there is a limit to what Log Analytics will allow to be exported at one time (kind of like the 10K limit on the number of rows you can see when querying the logs)?
Dec 11 2019 10:17 AM
10k for the query (as you mention), 500K for the api https://docs.microsoft.com/en-us/azure/azure-monitor/service-limits - so you may need two bins - each at 500k ?
Dec 11 2019 01:11 PM
@CliveWatson Thanks, I read about that limitation in one page I was looking at. For some reason I cannot even get the 500K.
Dec 11 2019 02:17 PM
I must be running into the size limit of 64Mb since if I just return 1 column I get my 500K rows. :(
Dec 12 2019 12:31 AM
Are you able to summarize the data in some way (I know this reduces the accuracy for PowerBI) but do they really need 1m rows? Just a small change helps...
AzureActivity
| project ActivityStatus
AzureActivity
| summarize count(ActivityStatus) by bin(TimeGenerated,1s)
Go to Log Analytics and Run Query
In the above Query #1, it hits the 10k limit, Query #2 returns 6681 with just a 1s bin.
Dec 12 2019 05:36 AM
@CliveWatson Thanks again. I'll see what I can do to adjust the needed queries.