waka / kcl-rb Goto Github PK

I am using this library to produce and consume message from and to kinesis stream. The functionality of this library is working as expected. Initially i tried few sample and it is working fine.

But now I am facing one issue. Whenever i create new stream and start both Producer and consumer and send messages entire flow is working fine. If i ran the consumer continuously also no issues in pipeline.

But when i stop the consumer for some time (Idle for 5 to 6 hrs) and start the consumer again and start pushing the messages again producer is able to successfully send the message and also showing in AWS monitoring. But consumer is not able to receive the record and no error in console also.

i tried below things also.

• different shard iterator (manually changing in the code)
• Verified any issue in dynamodb sequencing. No issues
• Also deleted the record from dynamodb. Still it is adding record with sequence number as 'test'. Not sure what is this.

When i stop the consumer and restart within 5 to 10 mins , no issues. But after 5 to 6 hrs means it will not read.

Only solution working is i need to delete the stream and need to create, then it will work.

Is this repo still maintained? If so I'd love to make some improvements to it to make it more composable. Creating clients as it is does not work for non access key based authorization (we should be able to just pass in our own clients that have the credentialing properly set up)