Comments (10)
I’ve thought about it a bit and I’d say I’m reluctant to implement this. There are subtle differences between letting code run on another thread and running it on the same thread, and I don’t like things that work most of the time but sometimes break. :)
For example, we would probably not be able to get rid of the postMessage()
calls because the value serialization/deserialization steps affect data layout, and in the most extreme case, anything that uses Atomics.wait()
/Atomics.notify()
would break pretty badly (i.e. by silently deadlocking).
I think spawning a single separate thread makes sense, even if there is only one CPU.
from piscina.
I'm not sure it's a great idea. Using multithreading allows to keep processing things in the background and keep the event loop healthy / responsive to external requests.
from piscina.
Entirely possible. If those buffers are not being exposed to users, then using a SharedArrayBuffer
makes sense, I think. For any Buffer
that is exposed to users, I would still marshall
from piscina.
Yes, but it should degrade gracefully in the off chance there is only a single core. It's certainly not ideal and I think the recommendation would be not to use piscina if you know for certain you're on a single core system (there are better solutions) but if that can't be known in advance then an internal no-thread mode would likely be good.
from piscina.
I don't see any in the case of a long CPU-bound task. Without threads, the event loop is going to be blocked.
from piscina.
@mcollina... what behavior would you expect to be reasonable if a user creates a Piscina instance on a single core machine?
from piscina.
I would expect to use a thread that competes for CPU time with the current one. The OS will guarantee both threads a fair share of CPU, so none of them would block. If we run the task on the main thread and it's CPU-bound, it will block the event loop.
from piscina.
Whatcha think @addaleax ? I'm happy with @mcollina's point but want to make sure you are before closing this.
from piscina.
@mcollina That still incurs the IPC overhead, but your point about even loop blocking is valid.
Perhaps I am just doing too much IPC by marshalling buffers instead of using SharedArrayBuffer
and the transferList
argument. The latter do not incur as much performance penalty, do they?
from piscina.
Think we've got consensus then! Closing!
from piscina.
Related Issues (20)
- TypeScript: Could not find a declaration file for module 'piscina' HOT 13
- Any particular reason for the 1100+ lines `src/index.ts`? HOT 1
- Support for `AsyncIterators` HOT 1
- Block the others thread when set minThreads = 1 HOT 3
- No handler function exported after building via webpack HOT 6
- How can I pass service between service and workers? HOT 3
- Piscina and @types/node > 20.8.0 HOT 2
- Threads are re-created when calling `destroy` HOT 2
- Increase memory consumption HOT 9
- TypeScript + ESM modules + piscina v3.2.0 HOT 1
- Default TaskQueue implementation is slow for a large number of queued tasks HOT 5
- How to distribute message data to each worker? HOT 1
- Thoughts on m:n worker mapping? HOT 9
- The value of "val" is out of range HOT 3
- resourceLimits Working HOT 3
- Make Max Threads default to `os.availableParallelism()` https://nodejs.org/api/os.html#osavailableparallelism HOT 3
- Is there a programmatic way to kill all workers of a queue? HOT 4
- Errors thrown from Node vm.Script cause pool.run() to resolve to null instead of rejecting HOT 3
- Error [ERR_MODULE_NOT_FOUND]: Cannot find module '...\app.asar\out\main\worker.js' imported from ...\app.asar\node_modules\piscina\dist\src\worker.js HOT 3
- Express js
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from piscina.