#

aws-glue

Here are 44 public repositories matching this topic...

aws-data-wrangler

awslabs / aws-data-wrangler

Star

Pandas on AWS

mysql python emr aws data-science lambda aws-lambda athena etl pandas data-engineering redshift apache-parquet amazon-athena apache-arrow aws-glue glue-catalog amazon-sagemaker-notebook

Updated Aug 12, 2020
Python

awslabs / athena-glue-service-logs

Star

Glue scripts for converting AWS Service Logs for use in Athena

athena elb-logs alb-logs cloudtrail-logs cloudfront-logs vpc-flow-logs aws-glue s3-log-parser glue-scripts glue-job

Updated Sep 12, 2019
Python

aws-open-data-analytics-notebooks

aws-samples / aws-open-data-analytics-notebooks

Star

COVID Response - Analytics, AI, and data science API and sample notebooks

data-science machine-learning amazon-rekognition amazon-s3 amazon-athena amazon-sagemaker amazon-comprehend aws-glue

Updated Apr 23, 2020
Jupyter Notebook

tokern / piicatcher

Star

A data catalog for database tables and columns to track PII and PHI.

data database catalog snowflake data-catalog aws-athena aws-redshift phi pii aws-glue

Updated Jul 24, 2020
Python

aws-samples / bring-your-own-data-labs

Star

Bring your own data Labs: Build a serverless data pipeline based on your own data

aws analytics aws-s3 labs hands-on-lab aws-glue aws-quicksight

Updated Jun 29, 2020

aws-samples / analyzing-reddit-sentiment-with-aws

Star

Learn how to use Kinesis Firehose, AWS Glue, S3, and Amazon Athena by streaming and analyzing reddit comments in realtime. 100-200 level tutorial.

real-time reddit sentiment-analysis data-stream tutorials data-lake kinesis-firehose self-learning sentiment-classification amazon-athena aws-glue delivery-stream

Updated Jun 26, 2020
Python

aws-samples / data-lake-as-code

Star

Data Lake as Code, featuring ChEMBL and OpenTargets

aws aws-glue aws-cdk aws-cdk-constructs aws-lake-formation

Updated Aug 13, 2020
Jupyter Notebook

awslabs / amazon-athena-cross-account-catalog

Star

🌉 Reference implementation for granting cross-account AWS Glue Data Catalog access from Amazon Athena

amazon-athena aws-glue

Updated Aug 13, 2020
Python

vincentclaes / serverless_data_pipeline_example

Star

Build and Deploy A Serverless Data Pipeline on AWS

python aws aws-lambda aws-s3 serverless-framework aws-glue

Updated Nov 1, 2019
Python

GorillaStack / athena-cloudtrail-partitioner

Star

Automate the daily partitioning of your CloudTrail bucket in Athena

aws athena glue partitioning cloudtrail aws-athena cloudtrail-logs aws-glue gorillastack

Updated Jul 20, 2020
JavaScript

webysther / aws-glue-docker

Star

🐋 Docker image for AWS Glue Spark/Python

Updated May 26, 2020
Dockerfile

TrainingByPackt / Serverless-Architectures-with-AWS

Star

Discover how you can migrate from traditional deployments to serverless architectures with AWS

aws aws-lambda serverless s3-bucket s3-storage aws-kinesis serverless-architectures aws-glue

Updated Feb 1, 2019
JavaScript

tokern / lakecli

Star

A CLI to manage and monitor permissions in AWS Lake Formation

aws sql permissions aws-glue aws-lake-formation

Updated Mar 31, 2020
Python

aws-samples / amazon-deequ-glue

Star

Automated data quality suggestions and analysis with Amazon Deequ on AWS Glue

aws aws-glue deequ

Updated Aug 7, 2020
Scala

canyousayyes / aws-real-time-data-collection

Star

Demo for building Real Time Data Collection Pipeline on AWS

aws-lambda data-pipeline aws-firehose aws-glue

Updated Jan 8, 2019
JavaScript

mikaelahonen-solita / aws-glue-tutorial

Star

AWS Glue tutorial for data developers.

tutorial spark pyspark aws-glue

Updated Sep 2, 2019
Python

jonrau1 / AWS-ComplianceMachineDontStop

Star

Proof of Value Terraform Scripts to utilize Amazon Web Services (AWS) Security, Identity & Compliance Services to Support your AWS Account Security Posture.

Updated Apr 26, 2020
HCL

chgasparoto / terraform-aws-glue

Star

Terraform module which creates Glue resources on AWS

aws terraform terraform-modules aws-glue

Updated Oct 3, 2018
HCL

bdoepf / aws-etl-example

Star

AWS ETL example via AWS DMS & AWS Glue

spark terraform aws-s3 aws-glue aws-dms

Updated Mar 3, 2019
HCL

jhole89 / aws-glue-sbt-quickstart

Star

Example of how to set SBT up for local development of AWS Glue Scripts

apache-spark sbt quickstart aws-glue

Updated May 15, 2020
Scala

svajiraya / aws-glue-libs

Star

AWS Glue Libraries are additions and enhancements to Spark for ETL operations.

aws spark hadoop etl aws-glue

Updated May 13, 2020
Python

geeknam / aws-neptune-aml

Star

Personal take on GraphDB + AML with AWS Neptune + Glue + Lambda.

python aws finance aws-lambda serverless etl graph-database graphdb zappa aml aws-glue aws-neptune anti-money-laundering

Updated Nov 13, 2018
Python

akhilpatlolla / Generic_ETL_Utility_AWS_GLUE

Star

AWS Glue - Incremental Pull Script

aws snowflake pyspark aws-glue glue-snowflake gluepyspark

Updated Apr 10, 2019
Python

gchatterjee-git / Data-Pipeline-AWS

Star

This is a project which demonstrates creation of a data pipeline by scraping data using twitter API and creating a data delivery stream using Kinesis Firehose for ingesting data to Amazon S3.

python aws data big-data etl twitter-api aws-s3 bigdata kinesis python3 kinesis-firehose boto3 datapipeline real-time-processing aws-glue

Updated May 4, 2020
Python

xianchen2 / Financal_Data_Streaming

Star

Financal data streaming and analysis with AWS Kinesis and Athena

aws-lambda aws-s3 aws-kinesis aws-athena aws-glue

Updated Jun 9, 2020
Jupyter Notebook

mincloud1501 / DevOps

Star

DevOps에 대한 개념 이해와 AWS 개발자 도구를 활용한 실습 및 연구

Updated Jun 15, 2020
Java

TrainingByPackt / Serverless-Architecture-with-AWS-eLearning

Star

Discover how you can migrate from traditional deployments to serverless architectures with AWS

aws rest-api dynamodb lambda-functions amazon-kinesis amazon-web-services amazon-alexa amazon-rekognition amazon-sqs aws-elastictranscoder amazon-sns amazon-s3 amazon-athena aws-glue dynamodb-streams

Updated Feb 26, 2019
JavaScript

pexip-logs-in-aws

mlnrt / pexip-logs-in-aws

Star

Pexip Infinity log analysis on the AWS cloud

aws aws-lambda log aws-cloudformation aws-cloudwatch aws-athena aws-cloudwatch-logs aws-glue pexip

Updated Jun 24, 2019

taupirho / read-big-file-aws-athena-glue

Star

Continuing with my case study on reading a big data file, this is the fifth part of my trilogy :-) on how I got on reading a big'ish file with C, Python, spark-python and spark-scala, AWS Elastic Map reduce and AWS Athena.

aws sql big-data aws-athena aws-glue

Updated Jun 25, 2018
Python

msheikh24 / aws

Star

Resources for AWS Big data certification preparation

aws-elasticsearch aws-athena aws-kinesis-firehose aws-redshift aws-kinesis-stream aws-glue aws-labs

Updated Mar 18, 2020
TSQL

Improve this page

Add a description, image, and links to the aws-glue topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the aws-glue topic, visit your repo's landing page and select "manage topics."

You can’t perform that action at this time.