大数据入门指南 ⭐

A fast and versatile ETL tool that can transfer data between RDBMS and NoSQL seamlessly

💎🔥大数据学习笔记

A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.

Divolte Collector

Quick start: pip install jsoniq ⛈️ RumbleDB 2.0.0 "Lemon Ironwood" 🌳 for Apache Spark | Run queries on your large-scale, messy datasets (JSON, text, CSV, Parquet, Delta...) | Data Lakehouse with Updates, Scripting, Declarative Machine Learning and more

A hybrid Big Data pipeline architecture that combines a real-time streaming layer with a batch layer to process large datasets(Lambda Architecture)

Exports Hadoop HDFS content statistics to Prometheus

DC/OS SDK is a collection of tools, libraries, and documentation for easy integration of technologies such as Kafka, Cassandra, HDFS, Spark, and TensorFlow with DC/OS.

HDFS Shell is a HDFS manipulation tool to work with functions integrated in Hadoop DFS

A tool for scale and performance testing of HDFS with a specific focus on the NameNode.

NameNodeAnalytics is a self-help utility for scouting and maintaining the namespace of an HDFS instance.

Storage connector for Trino

Kafka Connect FileSystem Connector

基于wifi抓取信息的大数据查询分析系统

基于分布式的云笔记（参考某道云笔记），数据存储在redis与hbase中

Euphoria is an open source Java API for creating unified big-data processing flows. It provides an engine independent programming model which can express both batch and stream transformations.

基于Hadoop的分布式云存储系统 🌴

A data layout optimization framework for wide tables stored on HDFS. See rainbow's webpage

Hadoop FSImage Analyzer (HFSA)