Ever since its general availability in November 2021, Azure Schema Registry has provided a central repository for schema documents, essential for event-driven and messaging-centric applications, greatly simplifying schema management, governance and evolution and streamlining data pipelines for customers.
When we began, we supported Avro format due to its popularity in the open-source community and within the Apache Kafka ecosystem. However, as architectures have evolved, customers have asked us to enable additional formats so that they can onboard more workflows and use Azure Schema Registry for ALL their schema management needs.
On that note, we're excited to make a few announcements.
General availability of JSON Schema formats for Kafka applications
Today we are excited to announce the General Availability of JSON Schema support in Azure Schema Registry for Kafka applications.
JSON provides a simple, extensible model for development in an increasing cloud-native world. JSON Schema is the standard to support reliable use of the JSON data format in production-grade solutions. Additionally, JSON Schema’s rich ecosystem supercharges development with tools to generate documentation, interfaces, code, and other artifacts thus significantly reducing operational overhead.
Real time streaming workloads on Azure Event Hubs and analytics workloads on Microsoft Fabric can leverage JSON Schema with Azure Schema Registry to simplify schema management at scale.
To learn more about how to use JSON Schema with Azure Schema Registry, for Azure Event Hubs and Apache Kafka applications, refer to the documentation.
Examples
You can find examples of how to use JSON Schema with Azure Schema Registry SDK for different languages in the following links:
Public preview of Protobuf support
We're also excited to announce preview support for the Protobuf data format.
Protocol Buffers, often abbreviated as protobuf, is a language-neutral, platform-neutral, and extensible mechanism developed for the serialization of structured data. Protobuf's rich ecosystem allows developers to define data structures once in .proto files, and then use generated source code to supercharge development workflows.
To utilize protobuf in your client applications, you can use the Schema Registry REST API for various management operations.
To create a new schema group, you can call PutSchemaGroup and specify the "schemaType" in the request body as below -
"schemaType": "Protobuf"
Once the schema group has been created, you may PutSchema in that group, and specify "contentType" in the request headers as below -
"content-type" : text/vnd.ms.protobuf
Learn more
- To learn more about JSON Schema, visit the official website at JSON Schema (json-schema.org)
- To learn more about Azure Schema Registry, visit the documentation at Use Azure Schema Registry from Apache Kafka and other apps - Azure Event Hubs | Microsoft Learn
- To learn more about Azure Schema Registry REST API, see the Schema Registry REST API overview.
- To learn more about Azure Event Hubs, visit the documentation at Azure Event Hubs documentation | Microsoft Learn
Microsoft
