Comments (5)
Worker threads in general have a ready
event, yes. In Piscina, runTask()
will not attempt to dispatch tasks to workers until after the worker signal they are ready.
from piscina.
Hey! Kind of late to the party but I believe the use case is interesting.
You want to do a warm-up of the threads, so they are ready beforehand (e.g. warm it up before starting to receive requests, similar to warming up the cache).
I agree with @jasnell that a ready
might not be useful, but we already have minThreads
at hand that can be used as a baseline, and Piscina ensures those minimum workers are available before starting processing tasks.
from piscina.
Worker threads in general have a
ready
event, yes. In Piscina,runTask()
will not attempt to dispatch tasks to workers until after the worker signal they are ready.
I know that Piscina use worker's ready
event inside,
but maybe we need a ready
event from Piscina.
start server -> wait all threads ready (use minThreads) -> server listen()
from piscina.
Sorry for the later response. I'm not sure a ready event for piscina is useful, to be honest. Tasks are queued until there's a worker available and there's really no reason an application should have to wait to use the worker pool. Can you expand a bit on the use case?
from piscina.
When using on a server, the first few response will be too slow.
this happens especially when we have a big service, and the server restarts a lot per day (because of code iteration).
if we have a ready event, we can make some server restart first,wait ready,then restart others.
anyway, this maybe a extreme case.
I found a trick way to do this:
async function initThread() {
let threadNum = 10;
let tasks = [];
while (threadNum--) {
// just init, thread can use `isWarmup`
tasks.push(piscina.runTask({ isWarmup: true }));
}
await Promise.all(tasks);
}
from piscina.
Related Issues (20)
- use `Atomic.waitAsync` instead of `Atomics.wait` HOT 3
- More customisable scheduling HOT 1
- How to check if queue has room before enqueuing HOT 2
- Extend support for Node v16, v18 and v20
- TypeScript: Could not find a declaration file for module 'piscina' HOT 13
- Any particular reason for the 1100+ lines `src/index.ts`? HOT 1
- Support for `AsyncIterators` HOT 1
- Block the others thread when set minThreads = 1 HOT 3
- No handler function exported after building via webpack HOT 6
- How can I pass service between service and workers? HOT 3
- Piscina and @types/node > 20.8.0 HOT 2
- Threads are re-created when calling `destroy` HOT 2
- Increase memory consumption HOT 9
- TypeScript + ESM modules + piscina v3.2.0 HOT 1
- Default TaskQueue implementation is slow for a large number of queued tasks HOT 5
- How to distribute message data to each worker? HOT 1
- Thoughts on m:n worker mapping? HOT 9
- The value of "val" is out of range HOT 3
- resourceLimits Working HOT 3
- Make Max Threads default to `os.availableParallelism()` https://nodejs.org/api/os.html#osavailableparallelism HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from piscina.