Add configuration option 'multiline_flush_regexp' about fluent-plugin-concat HOT 6 CLOSED

Sorry for delay.
I cannot imagine concrete use case. Could you describe concrete use case with real log examples?

from fluent-plugin-concat.

I'm using Supervisor to start services in a Docker container. In my case it's simplest to print everything to stdout/stderr and use the Docker fluentd logging driver so I also know from which container a message comes. Messages from Supervisor might be multiline. I can recognize by regular expression if a message comes from Supervisor or a service. If a message from a service arrives a possible previous Supervisor multiline message is finished.

from fluent-plugin-concat.

How about multiline_start_regexp?

<filter>
  @type concat
  multiline_start_regexp /(supervisord log start line regexp|application log start line)/
</filter>

from fluent-plugin-concat.

This would treat the application log as multiline, too. So I would need to use flush_interval and timeout_label and additional code to handle the timeout to get the last log. This would make the config unnecessary complicated.

from fluent-plugin-concat.

@dontub Sorry for delay, could you show me the concrete logs.
I want to know how complex supervisord and application log.

from fluent-plugin-concat.

No response.

from fluent-plugin-concat.