Comments (2)
bootandy
commented on June 2, 2024
1
We moved from walkdir to jwalk because jwalk was faster for large filesystems. jwalk can run in parallel walkdir can't.
I have a branch where I have moved from jwalk to Burntsushi's ignore crate which seems to be even faster than jwalk.
I don't think I can remove any more sys calls but please feel free to show me where I can.
We already use pointers for the tree structure, we don't clone the objects
One way we could improve performance for the base case is to stop sorting the output and instead search linearly for the k largest objects but I think that improvement would be very minor in practice.
from dust.
bootandy
commented on June 2, 2024
1
Todo: Try passing round DirEntry objects instead of Path objects.
from dust.
Related Issues (20)
- Select a file as baseline rather than total HOT 2
- Is this snapcraft official? HOT 2
- [WINDOWS]: The argument '--number-of-lines <number_of_lines>' cannot be used with '--depth <depth>' HOT 4
- Unable to skip a subfolder using -X HOT 4
- Path with spaces are not recognized (Windows) HOT 2
- How can I remove space at the first character HOT 4
- How can I ignore file sizes that are smaller than 100k HOT 5
- relocation error: symbol pthread_getattr_np, version GLIBC_2.2.5 not defined in file libpthread.so.0 with link time reference HOT 1
- Visiting directory with hard linked files produces unstable result HOT 2
- "Did not have permissions" message is shown even when all the arguments are files HOT 1
- panicked at 'called `Result::unwrap()` HOT 11
- ThreadPoolBuildError: Resource temporarily unavailable HOT 1
- Add flag to only display directories HOT 1
- Symlink support HOT 2
- Add flag to ignore hard links HOT 5
- Feature request: Ignore files by filter file HOT 1
- Add option to not limit number of lines in the report HOT 1
- Feature request: only list files and sort them by size HOT 2
- Play nicer with Screen Readers HOT 6
- dust got significantly slower with version 0.8.1 HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dust.