s3

A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.

A library that allows you to easily mock out tests based on AWS infrastructure.

Official s3cmd repo -- Command line tool for managing Amazon S3 and CloudFront services

Continuous Archiving for Postgres

Scan for open S3 buckets and dump the contents

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Directly upload files to S3 compatible services with Django.

A Python library that allows you to interact with Amazon S3 Buckets as if they are your local filesystem.

NoDB isn't a database.. but it sort of looks like one.

Parallel uploads to Amazon AWS S3

Example end to end data engineering project.

A simple library for interacting with Amazon S3.

A S3 backed ContentsManager implementation for Jupyter

Demo of AWS S3 Walkthrough using Python

FestIn - S3 Bucket Weakness Discovery

Fast object detection, face recognition and S3 upload of ZoneMinder alarms.

Cleans up docker registry by removing untagged manifests from the registry

A collection of lambda functions to collect data from Cloudwatch, Kinesis, VPC Flow logs, S3, security-hub and AWS Inspector

Toolkit for storing files and attachments in web applications

Amazon S3 Transfer Manager for Python

Amazon S3 Find and Forget is a solution to handle data erasure requests from data lakes stored on Amazon S3, for example, pursuant to the European General Data Protection Regulation (GDPR)

Amazon S3 filesystem for PyFilesystem2

Relational data pipelines for the science lab

Python interface to the TileDB storage manager

Python script for AWS resources inventory (cheaper than AWS Config)

A Machine Learning API with native redis caching and export + import using S3. Analyze entire datasets using an API for building, training, testing, analyzing, extracting, importing, and archiving. This repository can run from a docker container or from the repository.

K.E.V. (Keys, Extras, and Values) is a Python ORM for key-value stores based on Valley. Currently supported backends are Redis, S3, and a S3/Redis hybrid backend. Based on Valley.

a python Path interface for file and cloud bucket storage

Benji Backup: A block based deduplicating backup software for Ceph RBD images, iSCSI targets, image files and block devices