Comments (4)
I have seen this too. Lumberjack seems to miss events if the file does not exists and then its harvested. See my comments in the 5th post of issues #61.
from logstash-forwarder.
This is a bug. Will work on a fix.
from logstash-forwarder.
The issue is the way prospector.go handles unknown files and starts the harvester. There is currently no difference between:
-
a file what was created while lumberjack was running thus its unknown and does not exist in .lumberjack,
-
files that are unknown due to a missing .lumberjack file, the files exist, but lumber has not seem before.
In the first case you would always want to start at the beginning, but in the latter you may not. The current logic always starts at the end. Agree that a flag to start at the beginning could be a nice feature. In fact there is pull request for that, though is at a global level and not a file config item.
from logstash-forwarder.
This is fixed in master. Will appera in 0.4.0
from logstash-forwarder.
Related Issues (20)
- Logstash Forwarder Keeps Rotated Files Open HOT 5
- Beta4 -> RC1, send fail
- logstash-forwarder tcp input HOT 4
- rotate logstash forwarder's log HOT 4
- Logstash-forwarder cannot get data from the beginning. HOT 2
- way to override 24hr inactivity in a file harvester? HOT 2
- logstash forwarder HOT 1
- how to exclude files using pattern HOT 1
- tailing log file not registering events (logstash forwarder with -tail=true) HOT 1
- Make offset field in LSF optional HOT 1
- Filebeat - transport.go:125: SSL client failed to connect with: read tcp connection reset by peer HOT 1
- logstash multiline codec not working as expected
- how to set logstash-forward encoding HOT 1
- Received fatal alert: bad_certificate HOT 2
- Minor miss in lumberjack documentation HOT 2
- Logstash-forwarder exclude gzip files HOT 7
- c HOT 1
- Run on the ARM (RaspberryPi) HOT 1
- Update Lumberjack documentation to latest
- How to update logstash 8.9.1 to 8.12.02
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from logstash-forwarder.