We are excited to announce that Azure Stream Analytics built-in Protobuf deserializer is now generally available! With the built-in deserializer, Azure Stream Analytics supports an out-of-the-box feature to align with the other file formats we support, including JSON and AVRO. Using Protobuf, you can handle data streams in a compact binary format, making it ideal for high-throughput, low-latency applications.
Protobuf
Protocol Buffers (Protobuf) is a language-neutral, platform-neutral mechanism for serializing structured data, developed by Google. It is widely used for communication between services or for saving data in a compact and efficient format.
Configure your Stream Analytics job.
Using the Protobuf deserializer is simple to configure. When setting up your Stream Analytics input, select the file format as Protobuf and then upload the Protobuf definition file (.proto file). Complete your configuration by specifying the message type and prefix style.
Steps to configure a Stream Analytics job
To set up your Stream Analytics job to deserialize events in Protobuf:
- After creating your job, go to Inputs.
- Click Add input and choose the desired input to configure.
- Under Event serialization format, select Protobuf from the dropdown list.
Protobuf definition file |
A file that specifies the structure and data types of your Protobuf event |
Message type |
When you define a .proto schema, each message represents a data structure with specific fields. Add the message type that you want to deserialize |
Prefix style |
The setting that determines how long a message is, to deserialize Protobuf events correctly |
We can’t wait to see what you’ll build with Azure Stream Analytics built in Protobuf deserializer. Try it out today and let us know your feedback. Stay tuned for more updates as we continue to innovate and enhance this feature.
Call to Action:
- For direct help with using the Azure Stream Analytics Kafka input, please reach out to askasa@microsoft.com.
- To learn more about Azure Stream Analytics click here
- To learn more about Azure Stream Analytics Protobuf deserializer click here
Published Nov 19, 2024
Version 1.0Vaibhav_Shrivastava
Microsoft
Joined October 08, 2024
Analytics on Azure Blog
Follow this blog board to get notified when there's new activity