Kinesia Stream Reader Status

Question

How do I know what percentage of data in a Kinesis stream the reader has already processed? I know that each reader has a checkpoint sequence number for each step, and I can also get the StartSequenceNumber value of each fragment from the description stream, however I don’t know how far the reader is in my data at the moment (I don’t know the last sequence number shard).

I was thinking about getting the last iterator for each shard and getting the last record serial number, however this does not work if there is no new data since I got the last iterator.

Any ideas or tools for this?

Thank!

Answer 1

, .

, Kinesis , AWS CloudWatch. , .

( ) , Kinesis. CloudWatch, , , , .

Kinesis, , (.. Kinesis, , )

, "", , Kinesis 24 ( ). (API) ( , ).

Answer 2

KCL, , IncomingRecords Cloudwatch Kinesis RecordsProcessed, , KCL.

, , 1 .

:

, , . , , .