Pinned

1. airflow-toolkit Public

   Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested data pipelines(DAGs) 🖥️ >> [ 🚀, 🚢 ]

   HCL 67 18

2. iot-python-webapp Public

   Live, real-time dashboard in a serverless docker web app, and deployed via terraform with a built-in CICD trigger-See Mock Website 🔍

   Python 26 13

3. dbt_bigquery_example Public

   Forked from emilieschario/jaffle_shop

   How to Automate SQL: dbt(data build tool) tutorial on bigquery with extensive NOTES 📓

   Python 21 8

4. serverless-data-pipeline-gcp Public

   🏭 Schedule a data pipeline in Google Cloud using cloud function, BigQuery, cloud storage, cloud scheduler, stack trace, cloud build, and pub/sub

   Python 13 3

5. aws-lambda-based-etl Public

   📁 Process individual files and perform data normalization: s3->secrets manager->RDS & s3

   Python 5 1

6. schedule-python-script-using-Google-Cloud Public

   🕓 Schedules a Python script to append data into Bigquery using Google Cloud's App Engine with a cron job

   Python 7 3