tudor-berariu / liftoff Goto Github PK
View Code? Open in Web Editor NEWLocal experiment manager
License: MIT License
Local experiment manager
License: MIT License
Line 515 in 771b523
The current condition
if ".__crash" in files and "err" in files:
misses the case when process ended in error without the file .__crash
being created.
This seems to happen when using multiprocessing
.
The documentation in README.MD
is not synced with the new api.
Let's say you have a slow, shared storage where $PERSISTENT/results/$experiment
resides.
Now you get a machine which has some fast storage to work with $TMP_DIR
.
The idea would be to lock some run in $PERSISTENT/results.$experiment
, copy data locally, let the process run, and then copy from $TMP_DIR
to $PERSISTENT
and remove the lock.
https://docs.python.org/3/library/os.html#os.scandir
Originally posted by @tudor-berariu in 7c9aff5#commitcomment-30654740
liftoff-abort
kills the main process but not the children.
liftoff-prepare should print a prettier message when folder is not empty
Change this:
File ".../liftoff/liftoff/prepare.py", line 70, in check_paths
assert False, f"Found this file: {f_path:s}.
Current message: This is Liftoff 0.2.1:er-benchmarks:1b04af3.
where er-benchmarks
is a branch in the folder liftoff
is called.
Combining {len(result):d} experiments.
Clocks are different on various machines which screws the ETA.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.