error_class="TypeError" error="can't convert StringIO into String" when sending record to Kinesis about aws-fluent-plugin-kinesis HOT 4 CLOSED

Thank you @danielgollas . I will look into this.

from aws-fluent-plugin-kinesis.

Hi! Any updates on this issue? Is anybody else running this version successfully?

from aws-fluent-plugin-kinesis.

Hi @danielgollas , sorry for my late response.
Can you update aws-sdk-core? Recently the line we are seeing issue in SDK has been updated.
It might help.
amazon-archives/aws-sdk-core-ruby#180

However I could not re-produce your issue with my environment. I am putting records to Amazon Kinesis successfully with td-agent. My config is here.

<match kinesis.test>
  type kinesis
  stream_name fluentd2
  region ap-northeast-1
  flush_interval 100
  random_partition_key
  detach_process 2
  num_threads 100
</match>

Can you share your config for td-agent as well? I will dig it. Velocity(records per seconds) is also good help for me to dig deeper.

Thanks!

from aws-fluent-plugin-kinesis.

Closing the issue. If anyone is still working with this, please open a new issue.
I believe we can achieve higher throughput easily because we now support PutRecords API.
https://github.com/awslabs/aws-fluent-plugin-kinesis/releases/tag/v0.3.0

from aws-fluent-plugin-kinesis.