flume ☆

« Back to VersTracker

Description:
Hadoop-based distributed log collection and aggregation

Type: Formula | Tracked Since: Dec 28, 2025

Links: Homepage | @ApacheFlume | formulae.brew.sh

Category: Devops

Tags: hadoop logging data-ingestion devops java

Install: brew install flume

About:
Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. It is built on Hadoop and features a simple and flexible architecture based on streaming data flows. Its main value is providing robust data ingestion capabilities into the Hadoop ecosystem.

Key Features:

Distributed and reliable data collection
Fluentd-like configuration with rich sources and sinks
Transaction-based approach to guarantee data delivery
Horizontal scalability and failover support

Use Cases:

Aggregating application logs into HDFS for batch analysis
Streaming website clickstream data to analytics systems
Collecting system and network logs for centralized monitoring

Alternatives:

Fluentd – Fluentd is a CNCF project with a lighter footprint and wider plugin ecosystem, while Flume is tightly integrated with the Hadoop ecosystem.
Logstash – Logstash is part of the ELK stack and offers powerful filtering, but is typically heavier on resource usage than Flume.

Version History

Detected	Version	Rev	Change	Commit