All geek questions in one place

Difference between Apache Beam and Apache Nifi

What are the uses for Apache Beam and Apache Nifi? Both of them seem to be data stream engines. In case both have a similar use case, which of the two is better?

+6
source share
1 answer

Apache Beam is an abstraction layer for stream processing systems such as Apache Flink, Apache Spark (streaming), Apache Apex, and Apache Storm. It allows you to write code according to the API standard, and then execute code using any of the underlying platforms. Theoretically, if you wrote your code against the Beam API, this code could work on Flink or Spark Streaming without any code changes.

Apache NiFi - , , MiNiFi, NiFi. NiFi , , , , , , . NiFi , , .

, . , .

NiFi ... Flink, Spark, Storm Apex, NiFi NiFi. - MiNiFi + NiFi Apache Kafka, Kafka.

+14

Source: https://habr.com/ru/post/1016326/

More articles:


All Articles