Apache Flume

An ingestion network to receive data and flow it into HDFS

Has sources, channels, and sinks

Source - where to read from

Sink - where to write to including acting as a source

Channel - A queue like Kafka, memory, or file

Apache Flume architecture

Search for: Apache Flume architecture