Blockchain ETL

Repositories

• ethereum-etl-airflow

  Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethereum-smart-contract-into-bigquery-in-8-mins-bab5db1fdeee

  bigquery ethereum gcp erc20 blockchain-analytics
  Python MIT 58 109 14 (1 issue needs help) 2 Updated May 25, 2021

• polygon-etl

  ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

  bigquery gcp polygon matic
  Python MIT 2 3 0 0 Updated May 24, 2021

• tezos-etl

  Python scripts for ETL (extract, transform and load) jobs for Tezos blocks, balance updates, and operations

  bigquery csv sql blockchain cryptocurrency tezos
  Python MIT 0 5 0 0 Updated May 23, 2021

• tezos-etl-airflow

  Airflow DAGs for exporting and loading the Tezos blockchain data to Google BigQuery
  Python MIT 0 1 1 0 Updated May 23, 2021

• bigquery-to-pubsub

  A tool for streaming time series data from a BigQuery table to a Pub/Sub topic

  bigquery time-series etl pubsub
  Python MIT 3 5 0 1 Updated May 17, 2021

• ethereum-etl

  Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ

  export bigquery aws csv sql etl ethereum
  Python MIT 262 1,031 38 (2 issues need help) 4 Updated May 15, 2021

• twitter-bot-cloud-function

  Google Cloud Function for tweeting Blockchain ETL alerts
  JavaScript MIT 0 1 0 1 Updated May 11, 2021

• public-datasets

  The list of public blockchain datasets in BigQuery

  bigquery bitcoin ethereum blockchain
  MIT 3 11 0 0 Updated May 4, 2021

• bitcoin-etl-airflow-neo4j

  Airflow DAGs for ingesting Bitcoin blockchain data to Neo4j

  bitcoin neo4j cryptocurrency graph-database
  Python MIT 4 9 0 6 Updated May 1, 2021

• ethers.js-bigquery

  ethers.js library, compiled for use in Google BigQuery

  bigquery sql ethereum ethereum-contract ethers-bigquery
  JavaScript MIT 1 10 0 3 Updated Apr 30, 2021

• ethereum-etl-postgres

  ETL for moving Ethereum data to PostgreSQL database

  postgres sql etl ethereum postgresql
  Shell MIT 4 15 2 0 Updated Apr 18, 2021

• zilliqa-etl

  Python scripts for ETL (extract, transform and load) jobs for Zilliqa blockchain data
  Python MIT 1 3 1 0 Updated Apr 5, 2021

• bitcoin-etl

  ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ

  export bigquery aws sql bitcoin etl gcp
  Python MIT 58 194 13 (1 issue needs help) 2 Updated Apr 4, 2021

• docker-zcashd

  Forked from dysnix/docker-zcashd
  Dockerfile 1 0 0 0 Updated Apr 2, 2021

• ethereum-etl-table-definition-cli

  CLI for generating table definitions for https://github.com/blockchain-etl/ethereum-etl-airflow
  Python MIT 0 1 0 0 Updated Mar 29, 2021

• band-etl

  ETL (extract, transform and load) tools for ingesting Band Protocol blockchain data to Google BigQuery and Pub/Sub
  Python MIT 1 4 2 0 Updated Mar 18, 2021

• blockchain-streaming-analytics

  Blockchain streaming analytics
  Java 0 1 0 2 Updated Feb 18, 2021

• icon-etl

  Python scripts for ETL (extract, transform and load) jobs for ICON blocks, transactions, receipts, and logs.
  Python MIT 4 6 0 0 Updated Feb 11, 2021

• ethereum2-etl-airflow

  Airflow DAGs for exporting Ethereum 2.0 blockchain data to Google BigQuery
  Python MIT 1 1 0 0 Updated Jan 8, 2021

• ethereum2-etl

  Python scripts for ETL (extract, transform and load) jobs for Ethereum 2.0 beacon blocks, attestations, deposits, slashings, validators, committees. Data is available in Google BigQuery
  Python MIT 4 18 6 0 Updated Dec 5, 2020

• icon-etl-airflow

  Airflow DAGs for exporting, loading, and parsing the ICON blockchain data.
  Python MIT 3 2 0 2 Updated Nov 23, 2020

• docker-dashd

  Forked from dysnix/docker-dashd
  Shell 1 0 0 1 Updated Nov 23, 2020

• blockchain-etl-dataflow

  Dataflow pipelines for Blockchain ETL. Connects Pub/Sub topics with BigQuery tables.
  Java MIT 5 3 0 1 Updated Nov 21, 2020

• docker-bitcoin-cashd

  Forked from dysnix/bitcoin-cash

  bitcoin-cash
  Shell 1 0 0 0 Updated Nov 20, 2020

• blockchain-etl-streaming

  Streaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes

  streaming real-time bitcoin ethereum realtime cryptocurrency
  Python MIT 11 14 2 1 Updated Nov 9, 2020

• iotex-etl

  ETL (extract, transform and load) tools for ingesting IoTeX blockchain data to Google BigQuery and Pub/Sub

  bigquery sql iotex blockchain-data
  Python MIT 3 3 0 0 Updated Oct 18, 2020

• pubsub-to-firestore-dataflow

  Dataflow pipeline that pulls messages from a Pub/Sub topic and saves them in a Firestore collection
  Java MIT 0 1 0 1 Updated Oct 13, 2020

• anomalous-transactions-detector-dataflow

  Dataflow pipeline for detecting anomalous transactions on the Ethereum and Bitcoin blockchains

  bitcoin blockchain cryptocurrency dataflow anomaly-detection
  Java MIT 1 1 0 1 Updated Oct 14, 2020

• band-dataflow-sample-applications

  Forked from GoogleCloudPlatform/dataflow-sample-applications

  This repository contains code for running Dataflow pipelines for processing public Band Protocol data in Google Cloud Platform
  Java Apache-2.0 27 3 0 0 Updated Oct 5, 2020

• data-studio-connectors

  Connect Google BigQuery crypto public datasets to Google Data Studio
  JavaScript 1 2 2 0 Updated Oct 5, 2020