search

twitchscience / kinsumer

Native Go consumer for AWS Kinesis streams.
Other
134 stars 35 forks source link

kinsumer doesn't update with new iterator after 5 mins #51

Open donginseattle opened 4 years ago

donginseattle commented 4 years ago

I got error that Kinsumer failed to refresh shard iterator after 5 min. It's repro every time I run Kinsumer. kinsumer/logger.go:16 Got error: Iterator expired. The iterator was created at time Wed Jan 15 05:31:22 UTC 2020 while right now it is Wed Jan 15 05:37:43 UTC 2020 which is further in the future than the tolerated delay of 300000 milliseconds. (%!s()) retry count is 3 / 3 2020-01-14T21:37:43.895-0800 ERROR k.Next returned error {"error": "shard error (shardId-000000000001) in getRecords: ExpiredIteratorException: Iterator expired. The iterator was created at time Wed Jan 15 05:31:22 UTC 2020 while right now it is Wed Jan 15 05:37:43 UTC 2020 which is further in the future than the tolerated delay of 300000 milliseconds.\n\tstatus code: 400, request id: d6e4061f-161f-c6f2-807c-a178d6bd00d3"}

itsmesrds commented 2 years ago

is this fixed ? or how to resolve this. ?

sneako commented 1 year ago

We have seen this error about once a week for the past 2-3 weeks.

2023/06/17 05:02:53 Got error: ExpiredIteratorException Iterator expired. The iterator was created at time Sat Jun 17 04:57:22 UTC 2023 while right now it is Sat Jun 17 05:02:53 UTC 2023 which is further in the future than the tolerated delay of 300000 milliseconds. retry count is 0 / 3
2023/06/17 05:03:06 ERROR: shard error (shardId-000000000000) in getRecords: ExpiredIteratorException: Iterator expired. The iterator was created at time Sat Jun 17 04:57:22 UTC 2023 while right now it is Sat Jun 17 05:02:53 UTC 2023 which is further in the future than the tolerated delay of 300000 milliseconds.