Apache Flume
satya - 7/14/2019, 12:00:08 PM
Briefly
An ingestion network to receive data and flow it into HDFS
Has sources, channels, and sinks
Source - where to read from
Sink - where to write to including acting as a source
Channel - A queue like Kafka, memory, or file
satya - 7/14/2019, 12:00:22 PM
Apache Flume architecture
Apache Flume architecture
satya - 7/14/2019, 12:01:03 PM
Flume architecture