Kafka Compression on Azure Event Hubs Public Preview
Published Nov 15 2023 12:00 PM 3,367 Views
Microsoft

Kafka compression

Microsoft is happy to announce the public preview of Kafka Compression for Apache Kafka on Azure Event Hubs.  Kafka Compression enables message producers to transmit compressed data which is decompressed by the consumer.  By compressing your payload, you are able to save a lot of bandwidth and reduce the memory overhead on the brokers supporting your traffic. 

Kafka producer application developers can enable message compression by setting the compression.type property.  

Compression.type = none | gzip

 

These changes are exposed in the header which then allows the consumer to properly decompress the data. 

 

The feature is currently only supported for Apache Kafka traffic and not AMQP or web service. 

 

There is more information on this feature in documentation at https://aka.ms/kafkacompression 

7 Comments
Co-Authors
Version history
Last update:
‎Nov 14 2023 10:30 PM
Updated by: