apache-avro

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

Benchmark comparing various data serialization libraries (thrift, protobuf etc.) for C++

Flexible, Fast & Compact Serialization with RPC

Apache Avro <-> pandas DataFrame

Generate Avro Schemas from a Python class. Serialize and Deserialize python instances with avro schemas

Examples for codefoundry.dev

Count records in Avro files efficiently

A pure python avro schema validator

Clean up attribute names for Apache NiFi to send to Apache Avro

Kafka consumer application which reads messages from Kafka and based on the schema registered in a schema registry and enriches the data. This is just a prototype on how we can efficiently evolve a schema and read messages with BACKWARD compatibility with out breaking the consumers. This application can be used as a base for a stateless stream processing application which would involve processing one event at a time or filtering though a stream of events.

Provide support for axon event serialization via apache avro.

Imaginary manufacturing company event-driven application examples

Producer and consumer of traffic data for Apache Kafka

Customer Relationship Management use case for InfluxData Webinar - 16/06/2020

Sample project to try out Apache Avro.

Kafka producer application which publishes messages to Kafka and registers the schema of the message in a schema registry

Samples related to data engineering, e.g. spark, embulk, airflow, etc.

Apache Kafka Producer and Consumer which uses Spark-Streaming and Avro Serialization written in Scala.

Este es un breve ejercicio para ejemplificar el uso de Apache Avro ™ utilizando Java.

This project aims to build a streaming application to perform real-time analytics of Covid-19 related tweets and deploy an ML model for real-time sentiment predictions.

schema registry using kafka avro

Apache Kafka Producer and Consumer which uses Avro Serialization written in Java.

Avro File using Apache Spark and Scala

Simulate alert streams for the Fink broker

A Java Program which uses Apache Avro to serialize and deserialize data from a .csv file.

A Vehicle Manager Project Using Java + Kotlin

Construct a streaming event pipeline around Apache Kafka and its ecosystem. Using public data from the Chicago Transit Authority, we will construct an event pipeline around Kafka that allows us to simulate and display the status of train lines in real time.

An Eclipse editor plugin for defining Apache Avro IDL

An Event Bus implementation using Apache Kafka and Apache Avro

Serialize your Spark Dataframes to and from Avro