Comments (3)
Hi, I don't understand the issue. Could you please explain further? Also please open an issue here: https://github.com/logstash-plugins/logstash-input-file
from logstash-output-elasticsearch.
Hi Suyog,
I am using logstash on apache server in which logs file are rotated every 10 MB, so for monitoring these file i am using wildcard char (i.e. * ) in logstash configuration file input. so suppose in a day 100 files are rotated logstash keep opens these 100 files and after some days number of open file by logstash is too high which is effecting the server performance.
If there is any alternative to resolve the above problem, Please forward it to me and if possible please add some solution in logstash input file configuration for monitoring only updated file in case of wildcard using in path.
from logstash-output-elasticsearch.
This sounds more like an input issue than one with the logstash-output-elasticsearch plugin.
That said, why tail log files when you can configure Apache to send JSON formatted logs directly to Logstash? That is, if you can add the alternate configuration. Then you won't have a file handle issue at all.
from logstash-output-elasticsearch.
Related Issues (20)
- `pipeline_shutdown_requested?` not found error with Logstash v7.17.x versions. HOT 2
- Invalid data stream configuration when using dlq_custom_codes option
- BREAKING: ssl_certificate_verification => true uses deprecated verifier since v11.14.0
- normalized SSL config not applied when LS core uses private-API build_client directly
- Unify the error behaviour for template installation and ilm
- Doc: Update docs to call out differences from standard offering
- Allow the creation of custom data streams HOT 1
- Reduce ES response size through use of filter_path HOT 3
- Use integration's metadata fields (id, index, pipeline) when present
- Use integration's metadata fields (_routing, _version, _version_type) when present
- New management of `version` and `version_type` corrupt datastreams processing
- Isolate datastream vs normal indexing decision into test fixture
- Plugin fails with permission denied error HOT 1
- Cannot bundle install due to gemspec deps HOT 1
- Doc: Update data streams info to explain implications of ECS settings
- Handling non UTF-8 data.
- Default values of `http_compression` and `compression_level` are incosistent HOT 2
- Determine if `data_streams => true` can be possible with ECS compatibility effectively disabled
- Doc: Expand `silence_errors_in_log` description to show possible values
- SSL settings changed and not documented HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from logstash-output-elasticsearch.