Apache Spark™ and Scala Workshops

Custom state store providers for Apache Spark

A curated list of Pulsar tools, integrations and resources.

Sentiment Analysis of a Twitter Topic with Spark Structured Streaming

Spark structured streaming examples with using of version 3.0.0

spark structured streaming via HTTP communication

Spark1.6和spark2.2的示例，包含kafka,flume,structuredstreaming,jedis,elasticsearch,mysql,dataframe

Extensible streaming ingestion pipeline on top of Apache Spark

Get Twitter trends with twitter4j, stream it to a Kafka topic, save it to MongoDB and visualize in Google Maps

Samples for using Kafka within Spark Streaming and Akka Actors, Akka Streams

A library having Java and Scala examples for Spark 2.x

This repository includes supervised and unsupervised machine learning methods which are used to detect anomalies on network datasets. Decision Tree, Random Forest, Gradient Boost Tree, Naive Bayes, and Logistic Regression were used for supervised learning. K-Means was used for unsupervised learning.

Real-time streaming data pipeline for Twitter Tweets

Analytics for IoT devices using Apache Spark Structured Streaming 2.4.0

Spark Structured Streaming with State Store

Get up and running quickly with Spark Structured Streaming on Azure Databricks using Azure Event Hubs

Structured Streaming Log Analysis

Research on legacy and structured streaming with Spark

Design and proof-of-concept for a Broker for astronomy using Apache Spark

Online latent state estimation with Spark

Repositorio para la clase de UAM, Máster en Business Intelligence, PARALELIZACIÓN DE DATOS, Modulo de Streaming

Stream processing pipeline for analyzing live chat data

Playstore apps rating analysis - Machine Learning on Bigdata- Loading streaming Data using Kafka and Flume

Spark structured streaming with unit tests integrated with Travis CI

This is a repository i have created to put up some of the knowledge i have gained around Big Data Technologies especially Spark, GraphX etc.

IBM Cloud Streaming Demo

Study project, apache kafka + apache spark