Comments (4)
Yes, good idea. Didn't really knew about that difference.
from opendirectorydownloader.
I also noticed in the manual stats that in the markdown table, the line |**Dirs:** 1.234 **Ext:** 20|**Total:** 0|**Total:** n/a|
should not show 0
and n/a
for the total amount of links and total estimated size of links. Something's fishy there... 🤔
from opendirectorydownloader.
This is all intentional, because of performance. If you would output the full statistics every time, and you are scanning a large directory, it can take longer than a second to generate with all the extensions. For a very large directory it might even take multiple seconds, or even 10+ seconds (you will have a directory with like millions of files).
And to use multiple seconds of CPU time every 30 seconds is wasteful and slows it all down. So you get the basic fast statistics automatically, if you want the detailed you need to press s
.
See the parameters for that:
https://github.com/KoalaBear84/OpenDirectoryDownloader/blob/master/src/OpenDirectoryDownloader/Statistics.cs#L43
Hopefully.. if/when it's based on SQLite this is no longer needed as a database should be fast enough, hopefully SQLite is fast enough.
from opendirectorydownloader.
Okay, that makes sense.
And what about aligning the output format a bit more? E.g. always include the thread count, only prefix the first line with the logging info, etc.?
That would make everything a bit more parse-able :)
from opendirectorydownloader.
Related Issues (20)
- Cloudflare HOT 11
- Support for http authentication HOT 5
- No URLs to save for AliceAndBooks.com HOT 6
- Crash when not specifying a protocol HOT 5
- No folder for LogArchives on systems with `/` as path seperator HOT 4
- SIGABRT on unknown cli args HOT 4
- Add version to JSON
- Add removal URL for uploaded files to JSON HOT 1
- Add mounting support HOT 5
- Actual OD Downloading support HOT 1
- Continous Downloading/Crawling depending on Timestamp HOT 1
- Copyparty `--force-js` support HOT 3
- Unsupported site HOT 2
- S3 support HOT 4
- 2.9.0.3 errors HOT 4
- Only single Chromium instance
- cant open in colab, giving error HOT 1
- JSON save error when using custom port HOT 1
- Ways to bypass Cloudflare HOT 1
- How to Paste URLs into the program. HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from opendirectorydownloader.