The Patterns of Scalable, Reliable, and Performant Large-Scale Systems

Apache Spark - A unified analytics engine for large-scale data processing

ClickHouse® is a free analytics DBMS for big data

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

Apache Flink

An open source cybersecurity protocol for syncing decentralized graph data.

The official home of the Presto distributed SQL query engine for big data

大数据入门指南 ⭐

An open source time-series database for fast ingest and SQL queries

PredictionIO, a machine learning server for developers and ML engineers.

The Data Engineering Cookbook

CMAK is a tool for managing Apache Kafka clusters

A distributed, fast open-source graph database featuring horizontal scalability and high availability

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

The most widely used Python to C compiler

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

Open-Source Web UI for Apache Kafka Management

Apache Beam is a unified programming model for Batch and Streaming data processing.

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs