The scaled-scheduler-go from darenliang

scaled-scheduler-go's People

Contributors

Stargazers

Watchers

scaled-scheduler-go's Issues

Benchmark

Tested with native python3.11 version of scheduler and go version scheduler and here is the results:

there are 10k noop functions
the result is impressive, go is 3 times faster than python version

Test Environment:

OS: Windows 11
CPU: Ryzen 5900x
RAM: DDR4 32gb

running all below in Ubuntu WSL2

python version:

(venv3.11) 20:14:59 Wed Feb 22 : zyin@Windows (tmux):~/dev/scaled
$ python -m unittest tests.test_client.TestClient.test_client
[INFO]2023-02-22 20:15:06-0500: logging to ('/dev/stdout',)
[INFO]2023-02-22 20:15:06-0500: ScaledClient: connect to tcp://127.0.0.1:2345
[INFO]2023-02-22 20:15:06-0500: beginning submit 100000 tasks
[INFO]2023-02-22 20:15:07-0500: completed submit 100000 tasks in 0:00:01.029573
[INFO]2023-02-22 20:15:07-0500: beginning gather 100000 results
[INFO]2023-02-22 20:15:37-0500: completed gather 100000 results in 0:00:29.883602
.
----------------------------------------------------------------------
Ran 1 test in 30.975s

OK
[INFO]2023-02-22 20:15:37-0500: ScaledClient: disconnect from tcp://127.0.0.1:2345

go version scheduler:

(venv3.11) 20:15:37 Wed Feb 22 : zyin@Windows (tmux):~/dev/scaled
$ python -m unittest tests.test_client.TestClient.test_client
[INFO]2023-02-22 20:16:11-0500: logging to ('/dev/stdout',)
[INFO]2023-02-22 20:16:11-0500: ScaledClient: connect to tcp://127.0.0.1:2345
[INFO]2023-02-22 20:16:11-0500: beginning submit 100000 tasks
[INFO]2023-02-22 20:16:12-0500: completed submit 100000 tasks in 0:00:01.042871
[INFO]2023-02-22 20:16:12-0500: beginning gather 100000 results
[INFO]2023-02-22 20:16:20-0500: completed gather 100000 results in 0:00:08.436920
.
----------------------------------------------------------------------
Ran 1 test in 9.543s

OK
[INFO]2023-02-22 20:16:20-0500: ScaledClient: disconnect from tcp://127.0.0.1:2345

Recommend Projects