Pinned

1. pyDag Public

   Scheduling Big Data Workloads and Data Pipelines in the Cloud with pyDag

   Python 4 1

2. wbz Public

   A parallel implementation of the bzip2 data compressor in python, this data compression pipeline is using algorithms like Burrows–Wheeler transform (BWT) and Move to front (MTF) to improve the Huff…

   Python 5

3. uber-expenses-tracking Public

   The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such as Apache Airflow, AWS Redshift and Power BI.

   Jupyter Notebook 34 18

4. data-engineer-challenge Public

   Challenge Data Engineer

   Python 11 2

5. pyspark-on-aws-emr Public

   The goal of this project is to offer an AWS EMR template using Spot Fleet and On-Demand Instances that you can use quickly. Just focus on writing pyspark code.

   Python 14 10

6. apache-spark-docker Public

   Dockerizing an Apache Spark Standalone Cluster

   VBA 20 5