The original Sparks tab disappears after a restart from a breakpoint.

Question

I have a Spark Streaming job running on a cluster (Spark 1.6) that transfers S3 breakpoints. When I get started at the initial stage, I see the Streaming tab. However, when I restart the task from the checkpoint, the Streaming tab disappears. The job still works as a streaming job, and I see that the batches are displayed in the configured batch interval. See below.

If I delete the checkpoint data, the tab will return. I suspect that the Streaming tab is incorrectly registered when restarting from a checkpoint.

Spark Streaming. , , ?

- , ?

Answer 1

, . , "" - .

, , S3. , . , , .