What is FlumeJava?

Apache Flume

Search for: Apache Flume

About Apache Flume

Kafka, Apache Flume

Search for: Kafka, Apache Flume

Here is how Kafka and Flume work together

Flume connects data sources and sinks in a topology via channels.

It is agnostic to soruces, sinks, and channels

Data flows between them

However if the channels are not fault tolerant data loss can happen

So Kafka can be used as a channel

So flume is the set of highways that delivers events

Apache storm can process the events delivered flume

So apache spark works better with Kafka, while Apache storm works better with flume