Apache Arrow

DuckDB

duckdb/duckdb

TrendingPopular

In-process analytical SQL database; the SQLite of analytics, querying Parquet, CSV and Iceberg directly.

Trino

trinodb/trino

Popular

Distributed SQL query engine for federated analytics over lakes, warehouses and databases.

Apache Parquet

apache/parquet-java

Popular

Ubiquitous open columnar file format for analytics, the storage layer under most lakes.

Apache DataFusion

apache/datafusion

Rising

Extensible Rust query engine on Arrow, used as the foundation for many new databases.

Amazon Athena

aws.amazon.com

AWS's serverless SQL service for querying S3 data and Iceberg tables, based on Trino.

Presto

prestodb/presto

Meta's original distributed SQL engine, now with a native C++ (Velox) execution path.

Starburst

starburst.io

Enterprise Trino platform (Galaxy and Enterprise) for lakehouse analytics and data products.

Dremio

dremio/dremio-oss

Iceberg-native lakehouse query engine with semantic layer and reflections for acceleration.

pandas

pandas-dev/pandas

Popular

The ubiquitous Python DataFrame library for data cleaning, analysis and I/O.