A Python automated ELT pipeline that routinely aggregates 20+ million rows of parcel data from numerous local government departments for the Regional Entity Database.
python
aws
sqlalchemy
airflow
sql
postgresql
data-engineering
unittest
professional
plpgsql
boto3
redb
-
Updated
Dec 13, 2020 - PLpgSQL