Blog Post

Analytics on Azure Blog
2 MIN READ

Generally Available:Protocol Buffers (Protobuf) with Azure Stream Analytics

Vaibhav_Shrivastava's avatar
Nov 19, 2024

We are excited to announce that Azure Stream Analytics built-in Protobuf deserializer is now generally available! With the built-in deserializer, Azure Stream Analytics supports an out-of-the-box feature to align with the other file formats we support, including JSON and AVRO. Using Protobuf, you can handle data streams in a compact binary format, making it ideal for high-throughput, low-latency applications.

Protobuf
Protocol Buffers (Protobuf) is a language-neutral, platform-neutral mechanism for serializing structured data, developed by Google. It is widely used for communication between services or for saving data in a compact and efficient format.

Configure your Stream Analytics job.

Using the Protobuf deserializer is simple to configure. When setting up your Stream Analytics input, select the file format as Protobuf and then upload the Protobuf definition file (.proto file). Complete your configuration by specifying the message type and prefix style.

Steps to configure a Stream Analytics job

To set up your Stream Analytics job to deserialize events in Protobuf:

  • After creating your job, go to Inputs.
  • Click Add input and choose the desired input to configure.
  • Under Event serialization format, select Protobuf from the dropdown list.

 

 

 

 

 

 

 

 

 

 

Protobuf definition file

A file that specifies the structure and data types of your Protobuf event

Message type

When you define a .proto schema, each message represents a data structure with specific fields. Add the message type that you want to deserialize

Prefix style

The setting that determines how long a message is, to deserialize Protobuf events correctly

 

We can’t wait to see what you’ll build with Azure Stream Analytics built in Protobuf deserializer. Try it out today and let us know your feedback. Stay tuned for more updates as we continue to innovate and enhance this feature.

 

Call to Action:

  • For direct help with using the Azure Stream Analytics Kafka input, please reach out to askasa@microsoft.com.
  • To learn more about Azure Stream Analytics click here
  • To learn more about Azure Stream Analytics Protobuf deserializer  click here
 
Published Nov 19, 2024
Version 1.0
No CommentsBe the first to comment