Apache Flume

satya - 7/14/2019, 12:00:08 PM

Briefly

An ingestion network to receive data and flow it into HDFS

Has sources, channels, and sinks

Source - where to read from

Sink - where to write to including acting as a source

Channel - A queue like Kafka, memory, or file

satya - 7/14/2019, 12:00:22 PM

Apache Flume architecture

Apache Flume architecture

Search for: Apache Flume architecture

satya - 7/14/2019, 12:01:03 PM

Flume architecture