All geek questions in one place

Technological Challenges

I have a stream of discrete events that enter my system, and I need to apply rules based on the content of each event. In addition, I want to apply complex event processing to these stream events.

Constraints 1. These rules are provided to the user and will be dynamically changed. 2. I do not want to restart my system whenever a rule is applied. 3. HA 4. Only mature open source solutions

Possible ways. 1. Launch the Esper CEP inside the assault bolt
2. Drool inside the storm barrel

  • Will it handle a single event rule as well as complex events? Can rule changes restart my storm?

  • Can I dynamically insert rules into assault bolts?

Other solutions? Spark?

+6
source share
1 answer

Both Drools and Esper can dynamically enforce rules and do not require a restart of Storm or JVM.

Both Esper and Drools Fusion can handle complex events, usually with different tradeoffs.

Spark streaming, Storm, Yahoo S4 and Apache Samza are in the same distributed domain data flow. Any of these can be used to house Esper / Drools. For Storm, I think that since it repeats the tuples that you want to either remove duplicates before sending to Drools / Esper, or to design your continuous requests waiting for possible duplicate deliveries.

+5
source

Source: https://habr.com/ru/post/955715/

More articles:


All Articles