Apache Flume is a distributed, reliable, and available service for collecting, aggregating, and moving log data.
- Source-channel-sink architecture
- Reliable and scalable ingestion
- Supports multiple collectors and sinks
- Centralized log ingestion
- Streaming logs into HDFS or other storage
- Open-source and self-hosted
- Documentation: https://flume.apache.org/
- Source Code: https://github.com/apache/logging-flume
Flume Setup