Data integration platform for ELT pipelines from APIs, databases & files to warehouses & lakes.
-
Updated
Dec 30, 2023 - Python
Data integration platform for ELT pipelines from APIs, databases & files to warehouses & lakes.
An orchestration platform for the development, production, and observation of data assets.
Fancy stream processing made operationally mundane
🧙 The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data.
The open source high performance data integration platform built for developers.
Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
Build data pipelines, the easy way 🛠️
Privacy and Security focused Segment-alternative, in Golang and React
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ
Quadratic | Data Science Spreadsheet with Python & SQL
Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
Actively curated list of awesome BI tools. PRs welcome!
Data processing & ETL framework for Ruby
A curated list with resources about node-based UIs
A lightweight stream processing library for Go
A Python stream processing engine modeled after Yahoo! Pipes
Add a description, image, and links to the etl topic page so that developers can more easily learn about it.
To associate your repository with the etl topic, visit your repo's landing page and select "manage topics."