Hubs, Sharding and Partitioning
It seems there is a some misunderstanding related to sharding and partitioning when talking about IoT and Microsoft Azure platform. Here is my recommendation about how we should thnk about this. EventHub uses internally messaging feature called 'partitioning'. To understand how that works I would recommend to read more about this in context of service bus. It basically enables multiple message brokers instead of a single one. So, this is called partitioing even if some people might call this shrading. IotHub also uses same (or similar) technic as EventHub. However, when we talk about IotHub 'shards' we do not think about partitioning on message level. It is rather using of multiple IotHubs inside of same solution. This is not some specific technology under the hub. To use multiple IotHubs inside of a single solution, You should decide how device provisioning is done. Dev1-Hub1, Dev2->Hub2 etc.Azure Stream Analytics now available on IoT Edge
Today, we are announcing the public preview of https://azure.microsoft.com/en-us/services/stream-analytics/ running on https://azure.microsoft.com/en-us/campaigns/iot-edge/. Azure Stream Analytics on IoT Edge empowers developers to deploy near-real-time analytical intelligence closer to IoT devices so that they can unlock the full value of device-generated data. Designed for customers requiring low latency, resiliency, efficient use of bandwidth and compliance, enterprises can now deploy control logic close to the industrial operations and complement Big Data analytics done in the cloud. Read about it in the https://azure.microsoft.com/en-us/blog/azure-stream-analytics-now-available-on-iot-edge/.
Office 365 Security & Compliance - Stream Audit Logs -> Azure BLOB storage
From https://protection.office.com/unifiedauditlog (Office 365 Security & Compliance) Home -> Audit log search How to load the daily audit log files to Azure Blob storage? Is there any possibility to do so? Please suggest your valuable ideas. Thanks in advance.
Issue with deployment of Hybrid Topology to Linux HDInsight Storm Cluster
I used a simple Hybrid (C#/Java) Storm Topology which is reading data from an Azure Event Hub and steams the data to a WebApplication where the data was visualized directly within a chart. This worked perfectly with a "Windows" Storm Cluster on Azure. However, Microsoft decided to stop the offering of "Windows" Storm Clusters and since some months only allows to use "Linux" Storm Clusters in Azure. I'm still able to deploy my topology successfully from Visual Studio, however it seems the topology just never really arrives on the server. I can not see any Bolt or Spout in the Topology Viewer in Visual Studio: (Picture 1) Also I'm not able to see a Topology in the Storm Web UI: (Picture 2) So I really think the topology is correct, I even tried a sample topology from Microsoft. However something seems not to work with this deployment. Does anybody has an idea whats going wrong here? I'm glad to provide more information if needed.Deploy an Azure StreamAnalytics Job on the IoTEdge
The second version of the Microsoft IoTEdge solution is now available as Public Preview. In this version, you can run predefined modules like Modbus, build your own modules, deploy Azure Machine Learning modules, deploy Azure Functions and you can deploy Azure StreamAnalytics jobs. The concept is pretty simple, as always you have to create an ASA job, define inputs, outputs and a query. But this time the ASA will run on a local device: Microsoft provides documentation here and here explaining how to deploy your ASA modules. Let's dig a bit deeper into it. Read the full blog hereAzure Percept Data Stream to PowerBI
Trying to stream Data from Azure Percept eye module through steam analytics and into PowerBI. The Neural Network fields is a nested array in JSON. See below screenshot with output results showing the array as "new". Trying to figure out how to parse out the elements of the array so I can use this in PowerBI.
Enriching stream data by reference data in stream analytics task
I have a task of streaming client actions. I need to add some fields from the client reference. Clients are stored in Synapse. I see that reference data is adding via file or Azur SQL in the streaming task. What's the best way to do it, via a file or a database? How do I create / update a file / table? Using the Data Factory on the trigger to insert a new client into the Synapse?Tweet Sentiment Analytics made easy by Azure Services
I have written an article that explains how you can perform Tweet Sentiment Analytics using services from the Azure cloud. You can find the article on https://www.linkedin.com/pulse/tweet-sentiment-analytics-made-easy-azure-services-narendra-angane
