Description:
Apache Arrow DataFusion and Ballista query engines
|
|
Type: Formula
|
Latest Version: 51.0.0@0
|
Tracked Since: Dec 17, 2025
|
|
Links:
Homepage |
@ApacheArrow |
formulae.brew.sh
|
|
Category: Databases
|
|
Tags:
sql
arrow
query-engine
rust
big-data
|
|
Install:
brew install datafusion
|
About:
DataFusion is a high-performance, in-memory query engine built on the Apache Arrow memory format. It provides a SQL interface and a DataFrame API for executing complex queries on diverse data sources. Ballista extends this capability to distributed computing, allowing queries to scale across a cluster of machines.
|
Key Features:
- SQL and DataFrame API support
- Columnar query execution using Apache Arrow
- Extensible query optimizer and UDF support
- Distributed execution via Ballista
|
Use Cases:
- Analyzing large datasets locally or in a cluster
- Building custom data processing pipelines
- Embedding a query engine into Rust applications
|
Alternatives:
-
DuckDB
– DuckDB is an embedded OLAP database, while DataFusion is primarily a query engine and library.
-
Apache Spark
– Spark is a general-purpose distributed computing framework, whereas DataFusion is focused on SQL-based data querying.
|
|
License: Apache-2.0
|
|
Bottles available for: arm64_tahoe, arm64_sequoia, arm64_sonoma, sonoma, arm64_linux, x86_64_linux
|
| Detected |
Version |
Rev |
Change |
Commit |
| Nov 19, 2025 11:58am |
|
0 |
VERSION_BUMP |
7bab76d0 |
| Oct 13, 2025 4:57am |
|
0 |
VERSION_BUMP |
905c823c |
| Sep 16, 2025 12:01pm |
|
0 |
VERSION_BUMP |
348be947 |
| Sep 15, 2025 6:49am |
|
0 |
VERSION_BUMP |
73fcfaf5 |
| Dec 15, 2024 11:25am |
|
0 |
VERSION_BUMP |
bcff5892 |
| Oct 30, 2024 9:30pm |
|
0 |
VERSION_BUMP |
7ef24d61 |
| Sep 11, 2024 7:45pm |
|
0 |
VERSION_BUMP |
a4228078 |
| Aug 11, 2024 10:03pm |
|
0 |
VERSION_BUMP |
8baa34e8 |
| Aug 11, 2024 9:28pm |
|
0 |
VERSION_BUMP |
54a8ddb0 |
| Apr 22, 2024 12:30pm |
|
0 |
VERSION_BUMP |
893bfd48 |
| Dec 17, 2023 9:29pm |
|
0 |
VERSION_BUMP |
b4c6fe54 |
| Oct 12, 2023 6:48pm |
|
0 |
VERSION_BUMP |
98c69687 |
| Oct 12, 2023 2:14pm |
|
0 |
VERSION_BUMP |
cd29a5c1 |
| Aug 15, 2023 1:05am |
|
0 |
VERSION_BUMP |
286ea67c |
| Apr 11, 2023 5:05am |
|
0 |
VERSION_BUMP |
3bb79b49 |
| Mar 27, 2023 3:45pm |
|
0 |
VERSION_BUMP |
528e9899 |
| Mar 27, 2023 7:21am |
|
0 |
VERSION_BUMP |
0af1e3b2 |
|