Data integration platform for ELT pipelines from APIs, databases & files to warehouses & lakes.
-
Updated
Dec 12, 2023 - Python
Data integration platform for ELT pipelines from APIs, databases & files to warehouses & lakes.
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
🧙 The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data.
The open source high performance data integration platform built for developers.
Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
SQLMesh is a data transformation framework that brings the benefits of DevOps to data teams. It enables data scientists, analysts, and engineers to efficiently run and deploy data transformations written in SQL or Python.
Kuwala is the no-code data platform for BI analysts and engineers enabling you to build powerful analytics workflows. We are set out to bring state-of-the-art data engineering tools you love, such as Airbyte, dbt, or Great Expectations together in one intuitive interface built with React Flow. In addition we provide third-party data into data sc…
Dataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs)
One framework to develop, deploy and operate data workflows with Python and SQL.
A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.
ReplicaDB is open source tool for database replication, designed for efficiently transferring bulk data between relational and non-relational databases
Use SQL to build ELT pipelines on a data lakehouse.
Add a description, image, and links to the elt topic page so that developers can more easily learn about it.
To associate your repository with the elt topic, visit your repo's landing page and select "manage topics."