Forum Discussion
Help me to connect from power bi web to azure log analytics
Hi phanikumar236 from your post it is not clear if you have read about this approach:
https://docs.microsoft.com/en-us/azure/azure-monitor/platform/powerbi
It is way straight forward. It is not live stream as relies on the setting refresh time.
There is no out of the box method to live stream data from Log Analytics to PowerBI. Also there is no out of the box method to send data from Log Analytics to Azure storage. If you are going with the approach of sending data from Log Analytics to Azure storage to Stream Analytics and than to PowerBI you are introducing a lot of point of failures which I am sure you are aware. The other problem is that to move data between so many points will have additional cost and for sure will not be live stream. Moving data out of Log Analytics to another storage like Azure blob has the following challenges you should consider:
- How do you know which data was moved and which not?
- What amount of data will be processed?
Taking that into account you could use some of the automation technologies like Logic App, Functions or Azure Automation to automate the processing of data from Log Analytics to Azure Storage. Taking into account that you want to be live stream I would choose Azure Functions but still I think you will not be able to achieve truly live stream. Even if you set some low time trigger on the Azure function you have to figure out which data you will query? If you choose a big amount of data to query and move to Azure Storage you will hit some API limits which you will need to overcome. Also you have to think at what interval the data you query appears in Log Analytics. Different data appears in different intervals. Additionally in some rare cases there could be slight delay in that interval. My point is that you have to build some complex sync mechanism to do all this work so you do not end up with doable data or missing data. It is certainly possible but definitely not easy to make.
This is probably not the answer you were expecting but I hope it is somehow useful to you. I would definitely recommend going with the default PowerBI integration if you can overcome that the data is not live streamed. As Log Analytics is the monitoring tool it is usually the end point for such data and PowerBI in such cases is used more of summarizing certain data there for reporting rather for live dashboarding. Of course your case seems to be different.
Hi phanikumar236 from your post it is not clear if you have read about this approach:
https://docs.microsoft.com/en-us/azure/azure-monitor/platform/powerbi
It is way straight forward. It is not live stream as relies on the setting refresh time.
There is no out of the box method to live stream data from Log Analytics to PowerBI. Also there is no out of the box method to send data from Log Analytics to Azure storage. If you are going with the approach of sending data from Log Analytics to Azure storage to Stream Analytics and than to PowerBI you are introducing a lot of point of failures which I am sure you are aware. The other problem is that to move data between so many points will have additional cost and for sure will not be live stream. Moving data out of Log Analytics to another storage like Azure blob has the following challenges you should consider:
- How do you know which data was moved and which not?
- What amount of data will be processed?
Taking that into account you could use some of the automation technologies like Logic App, Functions or Azure Automation to automate the processing of data from Log Analytics to Azure Storage. Taking into account that you want to be live stream I would choose Azure Functions but still I think you will not be able to achieve truly live stream. Even if you set some low time trigger on the Azure function you have to figure out which data you will query? If you choose a big amount of data to query and move to Azure Storage you will hit some API limits which you will need to overcome. Also you have to think at what interval the data you query appears in Log Analytics. Different data appears in different intervals. Additionally in some rare cases there could be slight delay in that interval. My point is that you have to build some complex sync mechanism to do all this work so you do not end up with doable data or missing data. It is certainly possible but definitely not easy to make.
This is probably not the answer you were expecting but I hope it is somehow useful to you. I would definitely recommend going with the default PowerBI integration if you can overcome that the data is not live streamed. As Log Analytics is the monitoring tool it is usually the end point for such data and PowerBI in such cases is used more of summarizing certain data there for reporting rather for live dashboarding. Of course your case seems to be different.