We discussed the following issues:
But in Spark2.2 added Spark Structured Streaming, it brings a lot of changes for streaming, and it is outstanding.
Spark Structured Streaming
Can it be said that Spark Strutured Streamingthis is streaming processing or still batch processing?
Spark Strutured Streaming
Now, what is the big difference between Apache Finkand Apache Spark Structured Streaming?
Apache Fink
Apache Spark Structured Streaming
Currently
Spark Structured Streaming , . , , ( , Flink), SQL n API; , SQL, . ( , ;)). , Flink ( , Databricks ).
, Spark ~ 1 , Flink. , , . API , , Spark Streaming.
:
Spark -, Flink . , Flink , Spark Community , ( ) .
Source: https://habr.com/ru/post/1684875/More articles:Why doesn't a valid regex for a password in an HTML5 template attribute work? - javascriptDoes my application use encryption? Firebase - iosRemove source control for a solution or project VS 2017 - gitHow to choose export match in my application? - iosSkip the __init__ argument of the object model class in the iteration query set - djangoВыдавать себя за пользователя с помощью учетной записи Google Maps API oauth2 (node.js) - node.jsBlock structure memory allocation for variables - c ++Angular Service Worker with FCM Push Notification - javascriptWhat does @ do in Postgres function calls? - postgresqlUsing the directive to define nested types - c #All Articles