apache-arrow

Instant Kubernetes-Native Application Observability

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Modern columnar data format for ML implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..

❄️ Coolest database around 🧊 Embeddable column database written in Go.

Manipulate JSON-like data with NumPy-like idioms.

Infrastructures™ for Machine Learning Training/Inference in Production.

A Rust DataFrame implementation, built on Apache Arrow

Replacing MongoDB, Neo4J, and Elastic with 1 transactional database. Features: zero-copy semantics, replaceable backends, and a vast ecosystem of bindings for C, C++, Python, Java, GoLang

A SQLite vtable extension to read Parquet files

Official Julia implementation of Apache Arrow

Geospatial extensions for Polars

Manipulate arrays of complex data structures as easily as Numpy.

Fletcher: A framework to integrate FPGA accelerators with Apache Arrow

Rust-based WebAssembly bindings to read and write Apache Parquet data

Convert a CSV to a parquet file.

Pod5: a high performance file format for nanopore reads.

A simple dataframe library for Ruby

In-memory, columnar, arrow-based database.

Java read and write example for Apache Arrow