All geek questions in one place

How to create a connection between two streams on a Spark structured stream? - Java 8

I know the connection between the two threads is not yet supported. But is there any way to do this anyway? Or do I need to wait for Spark 2.2.0? thank you

+5
source share
3 answers

Spark 2.2.0 still does not support streaming connection. You can see this ticket: https://issues.apache.org/jira/browse/SPARK-18791

+3
source

I recommend that you use Kafka streams rather than Structured Spark Streaming if you want to join streams. check this link to see how it can be done

0
source

Starting with the release of Spark 2.3, stream stream connections are now supported in structured streaming.

0
source

Source: https://habr.com/ru/post/1266959/

More articles:


All Articles