data-infrastructure

Postgres operator creates and manages PostgreSQL clusters running in Kubernetes

Production PostgreSQL for Kubernetes, from high availability Postgres clusters to full-scale database-as-a-service.

TensorBase is a new big data warehousing with modern efforts.

Highly available elephant herd: HA PostgreSQL cluster using Docker

A distributed event bus that implements a RESTful API abstraction on top of Kafka-like queues

A battle-tested, flexible & comprehensive monitoring solution for your PostgreSQL databases

KubeBlocks helps developers and platform engineers manage database workloads (MySQL, PostgresSQL, Redis, MongoDB, Kafka and vector databases) on K8s inside your own cloud account. It supports multiple clouds, including AWS, Azure, GCP, and Alibaba Cloud.

Python function to stream unzip all the files in a ZIP archive - without loading the entire ZIP file or any of its files into memory at once

Pipebird is open source infrastructure for securely sharing data with customers.

Python server to on-the-fly extract and serve vector tiles from an mbtiles file on S3

The Data Engineering Book - หนังสือวิศวกรรมข้อมูล ของคนไทย เพื่อคนไทย

JSON schema parser for Apache Spark

Build & Learn Data Engineering,Machine Learning over Kubernetes. No Shortcut approach.

Python function to construct a ZIP archive on the fly - without having to store the entire ZIP in memory or disk

Continuously sync folder to S3, using inotify under the hood

Spawns JupyterHub single user servers in Docker containers running in AWS Fargate

An open source data analysis platform with features for users with a range of technical skills

A DNS proxy server that conditionally rewrites and filters A record requests

Data dependency manager

Python function to extract rows from a SQLite file while iterating over its bytes