Comments (3)
hossain-rayhan
commented on July 30, 2024
1
Hi @pranavmarla, thanks for opening this issue. From the README, it seems like we don't have concurrency support for this plugin. While the investigation will take time, can you share any specific reason you cannot use our core (kinesis_firehose) plugin?
from amazon-kinesis-firehose-for-fluent-bit.
pranavmarla
commented on July 30, 2024
1
Thanks @hossain-rayhan. We would prefer to use this plugin instead since we previously experienced far worse performance (including outright crashing) in the core (kinesis_firehose) plugin -- see issue #3197 for details.
from amazon-kinesis-firehose-for-fluent-bit.
zhonghui12
commented on July 30, 2024
We fixed the bug in our core plugin and we are working on other fix now. Close this one because we'd prefer customers to use our kinesis_firehose plugin: https://docs.fluentbit.io/manual/pipeline/outputs/firehose that has worker support for concurrency.
from amazon-kinesis-firehose-for-fluent-bit.
Related Issues (20)
- Output plugin 'firehose' cannot be loaded HOT 1
- Records sent to stream arrive in bucket with all null values HOT 1
- How to add the timestamp from Fluent Bit to the record sent to Kinesis？
- Plugin is not allowing Retry for Throttled records HOT 11
- Add an option to send multiple log events as a record HOT 5
- replace_dots option for high performance version HOT 4
- Empty documents being sent to Firehose HOT 4
- Remove exponential backoff code from all plugins
- Support sub-second time reporting HOT 2
- Error sending empty batch on shutdown
- Dots in keys cause failure in shipping to elasticsearch from firehose. HOT 3
- Add support for the Arm64 architecture HOT 1
- Handling duplicate records HOT 9
- Truncate large log events HOT 1
- Exception with simple log delivery HOT 2
- [fyi] helm/charts incubator/fluent-bit-aws HOT 3
- Is this now deprecated in favour of the vanilla Firehose plugin? HOT 6
- Consider adding a flunet-bit kinesis plugin as well. HOT 5
- timestamp missing with kinesis output HOT 8
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from amazon-kinesis-firehose-for-fluent-bit.