Announcing new supported formats for Azure Schema Registry
Published May 21 2024 10:15 AM 934 Views
Microsoft

Ever since its general availability in November 2021, Azure Schema Registry has provided a central repository for schema documents, essential for event-driven and messaging-centric applications, greatly simplifying schema management, governance and evolution and streamlining data pipelines for customers.

 

When we began, we supported Avro format due to its popularity in the open-source community and within the Apache Kafka ecosystem. However, as architectures have evolved, customers have asked us to enable additional formats so that they can onboard more workflows and use Azure Schema Registry for ALL their schema management needs.

 

On that note, we're excited to make a few announcements.

General availability of JSON Schema formats for Kafka applications

Today we are excited to announce the General Availability of JSON Schema support in Azure Schema Registry for Kafka applications.

 

JSON provides a simple, extensible model for development in an increasing cloud-native world. JSON Schema is the standard to support reliable use of the JSON data format in production-grade solutions. Additionally, JSON Schema’s rich ecosystem supercharges development with tools to generate documentation, interfaces, code, and other artifacts thus significantly reducing operational overhead. 

Real time streaming workloads on Azure Event Hubs and analytics workloads on Microsoft Fabric can leverage JSON Schema with Azure Schema Registry to simplify schema management at scale. 

 

To learn more about how to use JSON Schema with Azure Schema Registry, for Azure Event Hubs and Apache Kafka applications, refer to the documentation. 

Examples 

You can find examples of how to use JSON Schema with Azure Schema Registry SDK for different languages in the following links: 

 

Public preview of Protobuf support

We're also excited to announce preview support for the Protobuf data format.

 

Protocol Buffers, often abbreviated as protobuf, is a language-neutralplatform-neutral, and extensible mechanism developed for the serialization of structured data. Protobuf's rich ecosystem allows developers to define data structures once in .proto files, and then use generated source code to supercharge development workflows.

 

To utilize protobuf in your client applications, you can use the Schema Registry REST API for various management operations. 

 

To create a new schema group, you can call PutSchemaGroup and specify the "schemaType" in the request body as below -

"schemaType": "Protobuf"

 

Once the schema group has been created, you may PutSchema in that group, and specify "contentType" in the request headers as below - 

"content-type" : text/vnd.ms.protobuf

 

Learn more 

 

Co-Authors
Version history
Last update:
‎May 20 2024 02:48 PM
Updated by: