gazmull / kh-snek Goto Github PK
View Code? Open in Web Editor NEWRESURRECTION IN PROGRESS - [R18] Dedicated Assets Tool for Kamihime DB.
Home Page: https://kamihimedb.win
License: MIT License
RESURRECTION IN PROGRESS - [R18] Dedicated Assets Tool for Kamihime DB.
Home Page: https://kamihimedb.win
License: MIT License
The CPU cores are wasted due to the current code only distributing Resources per character (which is 3 Resources on average). On average, only 3 CPU cores were being occupied by the DownloadManager. Currently using the latest commit on a 12-core cloud instance and I'm wasting cents each second passes by.
Currently I can only propose that to occupy all CPU cores: do a round-robin distribution on Character[]
as well. For of is very weak in this case so try to avoid it.
For Reference:
kh-snek/src/lib/DownloadManager/index.ts
Lines 43 to 59 in bfdb209
Not sure how this exactly works at the moment but current solution is look up by incremental values (e.g. once 4 EX episodes were extracted, and another batch got released, resume from 5th EX episode being ++4).
The last folder should be the episode's hash instead of DB's column name. What a massive blunder, but if this were to be considered a patch, the user will have to re-download all thousands of files again (Mine took 8 hours @ 100Mbps) unless I ignore existing files which is not really recommended in my part yet. It's not really a major breaking oversight, but just annoying as a structure overview. This will be considered for the next major version.
kh-snek/src/lib/DownloadManager/worker.ts
Line 154 in f13daab
The only multi-threaded section of this project is the "Download Manager." Extractor could benefit as well specially on operations that start from scratch which takes too long to be done in the current single-thread design.
Start from here:
Line 71 in c2daed9
โ with process argument -nw
or --nowebp
. Webp has no real use yet on KamihimeDB's Device.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.