fluentd_https_out's Introduction

Fluentdd_https_out

A fluentd buffered output filter that posts to https a json array of records

Installation

gem install 'fluent-plugin-https-json'

Usage

<match SOME_EVENT>
  type https_json
  buffer_path /tmp/buffer

  buffer_chunk_limit 256m
  buffer_queue_limit 128
  flush_interval 10s
  endpoint    http://127.0.0.1:3000/consume_json_arrays_of_some_event/

</match>

fluentd_https_out's People

Contributors

Stargazers

fluentd_https_out's Issues

Qstn: EOFError?

Hi,

I tried to use this plugin, but keep getting:

2014-03-30 13:55:23 +0000 [warn]: temporarily failed to flush the buffer. next_retry=2014-03-30 14:04:57 +0000 error_class="EOFError" error="end of file reached" instance=70061167835460
  2014-03-30 13:55:23 +0000 [warn]: /usr/lib/fluent/ruby/lib/ruby/1.9.1/net/protocol.rb:141:in `read_nonblock'
  2014-03-30 13:55:23 +0000 [warn]: /usr/lib/fluent/ruby/lib/ruby/1.9.1/net/protocol.rb:141:in `rbuf_fill'
  2014-03-30 13:55:23 +0000 [warn]: /usr/lib/fluent/ruby/lib/ruby/1.9.1/net/protocol.rb:122:in `readuntil'
  2014-03-30 13:55:23 +0000 [warn]: /usr/lib/fluent/ruby/lib/ruby/1.9.1/net/protocol.rb:132:in `readline'
  2014-03-30 13:55:23 +0000 [warn]: /usr/lib/fluent/ruby/lib/ruby/1.9.1/net/http.rb:2563:in `read_status_line'
  2014-03-30 13:55:23 +0000 [warn]: /usr/lib/fluent/ruby/lib/ruby/1.9.1/net/http.rb:2552:in `read_new'
  2014-03-30 13:55:23 +0000 [warn]: /usr/lib/fluent/ruby/lib/ruby/1.9.1/net/http.rb:1320:in `block in transport_request'
  2014-03-30 13:55:23 +0000 [warn]: /usr/lib/fluent/ruby/lib/ruby/1.9.1/net/http.rb:1317:in `catch'
  2014-03-30 13:55:23 +0000 [warn]: /usr/lib/fluent/ruby/lib/ruby/1.9.1/net/http.rb:1317:in `transport_request'
  2014-03-30 13:55:23 +0000 [warn]: /usr/lib/fluent/ruby/lib/ruby/1.9.1/net/http.rb:1294:in `request'
  2014-03-30 13:55:23 +0000 [warn]: /usr/lib/fluent/ruby/lib/ruby/1.9.1/net/http.rb:1287:in `block in request'
  2014-03-30 13:55:23 +0000 [warn]: /usr/lib/fluent/ruby/lib/ruby/1.9.1/net/http.rb:746:in `start'
  2014-03-30 13:55:23 +0000 [warn]: /usr/lib/fluent/ruby/lib/ruby/1.9.1/net/http.rb:1285:in `request'
  2014-03-30 13:55:23 +0000 [warn]: /usr/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluent-plugin-https-json-0.0.1/lib/fluent/plugin/out_https_json.rb:58:in `write'
  2014-03-30 13:55:23 +0000 [warn]: /usr/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.41/lib/fluent/buffer.rb:292:in `write_chunk'
  2014-03-30 13:55:23 +0000 [warn]: /usr/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.41/lib/fluent/buffer.rb:272:in `pop'
  2014-03-30 13:55:23 +0000 [warn]: /usr/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.41/lib/fluent/output.rb:305:in `try_flush'
  2014-03-30 13:55:23 +0000 [warn]: /usr/lib/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.41/lib/fluent/output.rb:131:in `run'

Can you please advise what does this mean?

Kaz

Recommend Projects