Python Stream Processing

Python client for Apache Kafka

Apache Kafka client for Python; high-level & low-level consumer/producer, with great performance.

450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Mesos, Riak, MongoDB, Memcached, Couchbase, CouchDB, Neo4j, Ambari, Cloudera, Hortonworks, MapR. Products: Attivio, Blue Talon, Datameer, H2O, WanDisco, Zaloni

[DEPRECATED] Docker images for Confluent Platform.

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

Kafka-based Job Queue for Python

asyncio client for kafka

Gathers scalable tensorflow and infrastructure deployment

Zenko is the open source multi-cloud data controller: own and keep control of your data on any cloud.

基于scrapy-redis的通用分布式爬虫框架

Ansible playbooks for the Confluent Platform

Datafaker is a large-scale test data and flow test data generation tool. Datafaker fakes data and inserts to varied data sources. 测试数据生成工具

Python Data Streams

我的个人技术博客（Python、Django、Docker、Go、Redis、ElasticSearch、Kafka、Linux）

后端面试题汇总（Python、Redis、MySQL、PostgreSQL、Kafka、数据结构、算法、编程、网络）

all kinds of scrapy demo

Cross-vendor normalisation for network syslog messages, following the OpenConfig and IETF YANG models

Dumps state of Storm Kafka consumers

python通用分布式函数调度框架 pip install function_scheduling_distributed_framework

A python wrapper for the KSQL REST API.

⚡A supercharged, interactive Kafka shell built on top of the existing Kafka CLI tools.

Epiphany is a full industrialized automation of Kubernetes and Docker plus additional builtin services/components like: - Kafka or RabbitMQ for high speed messaging/events - Prometheus and Alertmanager for monitoring with Graphana for visualization - Elasticsearch and Kibana for centralized logging - HAProxy for loadbalancing - Postgress for storage - KeyCloak for authentication

Kafka-based components for Scrapy

Real-time analysis of bitcoin markets with Kafka and Tensorflow Serving

Prometheus Kafka Consumer Group Exporter

Ansible playbook to deploy distributed technologies

🚨 Simple, self-contained fraud detection system built with Apache Kafka and Python

Karapace - Your Kafka essentials in one tool

Manage your topic's configuration (partitions, replication factor, parameters) and ACLs, and get stats, without any effort with this library. It does not use the Kafka scripts and does not require ssh connection to the remote broker.