Dynamically adding partitions to a topic/event hub under Event Hubs namespace
Event Hubs provides partitions to scale consumers for parallel processing. The concept of partitions belongs to Topics under Event Hubs namespace. Topics helps categorize the incoming messages and consumer in a group processes the events from one of the Topic partitions. When a Topic is created, the number of partitions are specified at the time of creation. For some special cases though, you may have to add partitions after the Topic has been created. This requires you to dynamically accommodate the addition of partitions. This blog describes the behavior of adding partitions to an existing Topic with Event Hubs. Dynamic additions of partitions is available only on Dedicated Event Hubs clusters and not on Standard Event Hubs namespace.Processing ordered IoT streams in Azure
There are thousands of articles on the Internet talking about how the cloud can be used to process discrete (un-ordered) streaming IoT data. But almost all are short on specifics and the design trade-offs you need to make when processing ordered IoT streams, at scale. This article discusses why scale can be difficult to achieve, especially when the ordering of the events (aka Series events) is important. Jeff Hollan wrote an article which illustrates the challenge when using Azure Functions, for example. And if you need a primer on Real-time processing, Events, Messages, Series events and Discrete events, please review the following articles: Real time processing Events, Data Points, and Messages - Choosing the right Azure messaging service for your data Choose between Azure messaging services - Event Grid, Event Hubs, and Service BusEvent Hubs Archive, what’s the new naming convention
First published on on Mar 20, 2017 We have listened to your wonderful feedback on EH Archive blob naming conventions and have now designed a simpler naming pattern, while at the same time capturing the essentials required for identifying the source of the archived blob.New Akka Streams and Apache Flink tutorials/samples for Event Hubs for Apache Kafka Ecosystems
First published on on Jun 13, 2018 Introducing two new Event Hubs for Apache Kafka Ecosystems tutorials - Akka Streams and Apache Flink!Event Hubs for Kafka Ecosystems combines the power and simplicity of Event Hubs with the wide ecosystem of Apache Kafka.
How is the Event Data's Sequence Number and Offset created on Event Hub?
Hi all; I did some tutorial about Event Hub. The sequence number and offset of a event look like a auto increament number (+1). I wonder if the number of event is too big or the event is last more than 7 days, will Azure Event hub delete and reset sequence and offset? If these properties reset, which point do begin ? (From 0,1 ... etc) Can you help me answer these questions above. Thanks in advance.
