Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.

Python SQL Parser and Transpiler

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Better SQL in Jupyter. 📊

CLI tool for dbt users to simplify creation of staging models (yml and sql) files

A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficiency and agility in data projects on AWS.

Timeseries Anomaly detection and Root Cause Analysis on data in SQL data warehouses and databases

Simple DDL Parser to parse SQL (HQL, TSQL, AWS Redshift, BigQuery, Snowflake and other dialects) ddl files to json/python dict with full information about columns: types, defaults, primary keys, etc. & table properties, types, domains, etc.

Pytest Fixtures that let you actually test against external resource (Postgres, Mongo, Redshift...) dependent code.

Main repo including core data model, data marts, reference data, terminology, and the clinical concept library

A SQL port of python's scikit-learn preprocessing module, provided as cross-database dbt macros.

Resources for video demonstrations and blog posts related to DataOps on AWS

A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for cloud data warehouse and Metabase to serve the needs of data visualizations such as analytical dashboards.

Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow

A Data Platform built for AWS, powered by Kubernetes.

locopy: Loading/Unloading to Redshift and Snowflake using Python.