Python Stream Processing

Python client for Apache Kafka

Apache Kafka client for Python; high-level & low-level consumer/producer, with great performance.

450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...

[DEPRECATED] Docker images for Confluent Platform.

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

Kafka-based Job Queue for Python

asyncio client for kafka

基于scrapy-redis的通用分布式爬虫框架

Gathers scalable tensorflow and infrastructure deployment

Zenko is the open source multi-cloud data controller: own and keep control of your data on any cloud.

Ansible playbooks for the Confluent Platform

Datafaker is a large-scale test data and flow test data generation tool. Datafaker fakes data and inserts to varied data sources. 测试数据生成工具

Python Data Streams

我的个人技术博客（Python、Django、Docker、Go、Redis、ElasticSearch、Kafka、Linux）

后端面试题汇总（Python、Redis、MySQL、PostgreSQL、Kafka、数据结构、算法、编程、网络）

all kinds of scrapy demo

Dumps state of Storm Kafka consumers

python通用分布式函数调度框架 pip install function_scheduling_distributed_framework

A python wrapper for the KSQL REST API.

⚡A supercharged, interactive Kafka shell built on top of the existing Kafka CLI tools.

Epiphany is a full industrialized automation of Kubernetes and Docker plus additional builtin services/components like: - Kafka or RabbitMQ for high speed messaging/events - Prometheus and Alertmanager for monitoring with Graphana for visualization - Elasticsearch and Kibana for centralized logging - HAProxy for loadbalancing - Postgress for storage - KeyCloak for authentication

Kafka-based components for Scrapy

Real-time analysis of bitcoin markets with Kafka and Tensorflow Serving

Prometheus Kafka Consumer Group Exporter

Ansible playbook to deploy distributed technologies

🚨 Simple, self-contained fraud detection system built with Apache Kafka and Python