What is the difference between periodic and dotted watermarks in Apache Flink?

It will be helpful if someone gives a usecase example to explain the difference between each of the Watermark APIs with the Apache flag below

  • Periodic Watermarks - AssignerWithPeriodicWatermarks[T]
  • AssignerWithPunctuatedWatermarks[T] water marks - AssignerWithPunctuatedWatermarks[T]
+5
source share
1 answer

The main difference between the two types of watermarks is how / when the method is called getWatermark.

periodic watermark

With periodic watermarks, Flink calls getCurrentWatermark()at a regular interval regardless of the flow of events. This interval is determined using

ExecutionConfig.setAutoWatermarkInterval(millis)

, ( ) , , , - / .

Flink checkAndGetWatermark() , .. assignWatermark(). , checkAndGetWatermark , , .

, - , .

, , , . , , .

+8

Source: https://habr.com/ru/post/1667555/


All Articles