Comments (3)
The default buffer size (which was also the only buffer size ever used) for SEARCH_V2 was 1MB. That's insanely large since we never ask for more than a few thousand items--and even if we did want more, they'd be out of date by the time we used them.
I'll add some instrumentation later to get closer to the right buffer size; however, you should see an improvement just by changing the default from 1MB to 16K. See the commit I just pushed for details.
from bees.
OK so we didn't usually need a meg but in some cases we did use over 512K.
I removed the initializer in the resize call which should get rid of the memset time.
from bees.
Seems much better now, sensible things like kernel calls, memcmp or crc64 are taking all the cpu time.
from bees.
Related Issues (20)
- GRUB: Extent not found after running bees HOT 4
- a segfault of bees HOT 2
- limit the dedup min size 64K for less fragment? HOT 2
- Bees crashes after 10 minutes of running HOT 1
- munmap when not actively scanning HOT 2
- Help with using Bees.in setup script HOT 8
- build failure with GCC 13 HOT 2
- How exactly is the compression method set and how might one go about changing it? HOT 1
- regression on linux 6.3.1: 'vmalloc error' during crawl HOT 16
- Cannot start beesd service on Archlinux HOT 5
- corrupted double-linked list HOT 17
- bees causes memory fragmentation and low cached memory HOT 23
- Bees fills the journal with 'LOGICAL_INO returned 0 refs' messages HOT 1
- Bees on Synology NAS HOT 9
- Multiple iSCSI fileIO Block Devices on One Btrfs Disk with bees HOT 21
- System service enable problem HOT 6
- Enhancement: exporting live stats HOT 1
- Used size increased by ~400GB while defragmenting HOT 2
- Mount prevent second run HOT 1
- bees seemingly cannot catch up with snapper snapshot creation HOT 16
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bees.