Fluentd application logs are not captured by either <match fluent.*> and <label @FLUENT_LOG> when SIGUSR2 signal is triggered. about fluentd HOT 3 CLOSED
DhanushAmbig
commented on September 24, 2024
DhanushAmbig
commented on September 24, 2024
Comments (3)
kenhys
commented on September 24, 2024
I've checked with more simple case:
<system>
<log>
format json
time_format %Y-%m-%dT%H:%M:%S%z
</log>
</system>
<source>
@type sample
tag sample
</source>
<match sample>
@type null
</match>
<label @FLUENT_LOG>
<filter fluent.*>
@type record_transformer
enable_ruby true
renew_record true
<record>
log ${ { message: record["message"] } }
type "log"
time ${record.has_key?("time") ? record["time"]: time.strftime('%Y-%m-%dT%H:%M:%S%z') }
</record>
</filter>
<match fluent.*>
@type stdout
<format>
@type json
</format>
</match>
</label>
Here is the outcome:
After emitting USR2 signal
{"time":"2024-07-09T14:05:17+0900","level":"info","message":"Reloading new config"}
{"time":"2024-07-09T14:05:17+0900","level":"warn","message":"both of Plugin @id and path for are not specified. Using on-memory store."}
{"time":"2024-07-09T14:05:17+0900","level":"warn","message":"both of Plugin @id and path for are not specified. Using on-memory store."}
{"time":"2024-07-09T14:05:17+0900","level":"info","message":"using configuration file: \n \n \n format json\n time_format %Y-%m-%dT%H:%M:%S%z\n \n \n
{"time":"2024-07-09T14:05:17+0900","level":"info","message":"shutting down input plugin type=:sample plugin_id="object:bb8""}
{"time":"2024-07-09T14:05:17+0900","level":"info","message":"shutting down filter plugin type=:record_transformer plugin_id="object:b54""}
{"time":"2024-07-09T14:05:17+0900","level":"info","message":"shutting down output plugin type=:stdout plugin_id="object:b68""}
{"time":"2024-07-09T14:05:17+0900","level":"info","message":"shutting down output plugin type=:null plugin_id="object:b90""}
{"time":"2024-07-09T14:05:17+0900","level":"info","message":"adding filter in @FLUENT_LOG pattern="fluent." type="record_transformer""}
{"log":{"message":"adding filter in @FLUENT_LOG pattern="fluent." type="record_transformer""},"type":"log","time":"2024-07-09T14:05:17+0900"}
{"time":"2024-07-09T14:05:17+0900","level":"info","message":"adding match in @FLUENT_LOG pattern="fluent." type="stdout""}
{"time":"2024-07-09T14:05:17+0900","level":"info","message":"adding match pattern="sample" type="null""}
{"log":{"message":"adding match in @FLUENT_LOG pattern="fluent." type="stdout""},"type":"log","time":"2024-07-09T14:05:17+0900"}
{"log":{"message":"adding match pattern="sample" type="null""},"type":"log","time":"2024-07-09T14:05:17+0900"}
{"time":"2024-07-09T14:05:17+0900","level":"info","message":"adding source type="sample""}
{"time":"2024-07-09T14:05:17+0900","level":"warn","message":"both of Plugin @id and path for are not specified. Using on-memory store.","worker_id":0}
{"log":{"message":"adding source type="sample""},"type":"log","time":"2024-07-09T14:05:17+0900"}
{"time":"2024-07-09T14:05:17+0900","level":"warn","message":"both of Plugin @id and path for are not specified. Using on-memory store.","worker_id":0}
{"log":{"message":"both of Plugin @id and path for are not specified. Using on-memory store."},"type":"log","time":"2024-07-09T14:05:17+0900"}
{"log":{"message":"both of Plugin @id and path for are not specified. Using on-memory store."},"type":"log","time":"2024-07-09T14:05:17+0900"}
{"time":"2024-07-09T14:05:17+0900","level":"info","message":"shutting down fluentd worker worker=0","worker_id":0}
{"time":"2024-07-09T14:05:17+0900","level":"info","message":"shutting down input plugin type=:sample plugin_id="object:94c"","worker_id":0}
{"time":"2024-07-09T14:05:17+0900","level":"info","message":"shutting down filter plugin type=:record_transformer plugin_id="object:8e8"","worker_id":0}
{"time":"2024-07-09T14:05:17+0900","level":"info","message":"shutting down output plugin type=:stdout plugin_id="object:8fc"","worker_id":0}
{"time":"2024-07-09T14:05:17+0900","level":"info","message":"shutting down output plugin type=:null plugin_id="object:924"","worker_id":0}
{"time":"2024-07-09T14:05:17+0900","level":"info","message":"restart fluentd worker worker=0","worker_id":0}
<label @FLUENT_LOG> seems working as expected. It may depend on environment or timing?
need to try reporter's config.
from fluentd.
github-actions
commented on September 24, 2024
This issue has been automatically marked as stale because it has been open 30 days with no activity. Remove stale label or comment or this issue will be closed in 7 days
from fluentd.
github-actions
commented on September 24, 2024
This issue was automatically closed because of stale in 7 days
from fluentd.
Related Issues (20)
- Fluentd causing inflated bandwidth bills in AKS HOT 1
- Enable OpenSSF Scorecard to enhance security practices across the project HOT 3
- Ruby uplift 2.5 -> 3.3 makes Fluentd startup 60x slower HOT 7
- D:/opt/calyptia-fluentd/lib/ruby/3.2.0/rubygems.rb:1342:in `rescue in <top (required)>': U+795E to ASCII-8BIT in conversion from UTF-16LE to UTF-8 to ASCII-8BIT (Encoding::UndefinedConversionError) HOT 5
- Fluentd causing inflated bandwidth bills in AKS HOT 4
- Bind to all network interfaces for both IPv4 and IPv6 HOT 10
- Flushing the buffer fails with `BSON::Error::UnserializableClass error="Value does not define its BSON serialized type: 1721203518"`. HOT 2
- Error event logs should include plugin id HOT 17
- remove_key_name_field true when key_name is message causes ArgumentError error="message does not exist" HOT 5
- 500 response when scraping prometheus metrics in kubernetes with istio service mesh HOT 2
- CI fails on Ruby HEAD HOT 2
- `warning: literal string will be frozen in the future` since Ruby 3.4.0
- `FrozenError: can't modify frozen String` in http_server plugin helper
- Improvement of OpenSSF Scorecard Score HOT 4
- v1.17.1 sometimes kills in_monitor_http_server_helper thread HOT 5
- Fluentd is not able to send .json extension file logs to logstash (fluent/fluentd-kubernetes-daemonset:v1.16.3-debian-opensearch-amd64-2.0)
- Fluentd uses the Kafka output plugin, and after manually deleting the topic, it gets recreated. HOT 1
- Add Fuzz-testing HOT 3
- Output forward connections are in CLOSE_WAIT state HOT 10
- Update/Reload without downtime
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.