Comments (6)
The idea would be that we allow for list-valued hyperparameters in a config space. Each component can be a Domain
or a fixed value.
Internally, this would be flattened when it comes to searchers and encodings.
This can certainly be done, but we should warn folks that high-D HPO is often failing if no special structure is present and assumed by the surrogate model.
from syne-tune.
One technical blocker is that command line arguments for SageMaker training jobs are limited in length. What is possible is to pass parameters to a script as JSON file config.json
. We could maybe provide some tooling to load this file inside a training script.
This is not a simple change.
from syne-tune.
https://github.com/awslabs/syne-tune/blob/main/benchmarking/nursery/tuning_with_hyperparameter_file
from syne-tune.
Example of how to read config from JSON file. This works for the local backend only at the moment. I can try and support this for the SageMaker backend as well.
from syne-tune.
#577 is adressing this issue to some extent. It allows to pass fixed lists to the training script, but all hyperparameters to be optimized still have to be elementary types.
from syne-tune.
I am closing this, since #577 is addressing the request partly. Since HPO methods are not ready to jointly tune many hyperparameters, we hesitate to offer list-valued domains, as this may send the wrong signal.
from syne-tune.
Related Issues (20)
- RemoteLauncher corrupts requirements.txt when not ending with newline HOT 5
- Conditional/Inactive hyperparameters HOT 6
- Troubles with maximising using MORandomScalarizationBayesOpt HOT 4
- Run BOHB/SyncBOHB using lcbench HOT 2
- Open `MultiObjectiveMultiSurrogateSearcher` to additional arguments HOT 2
- Simple example for learning curve plotting HOT 7
- Surprising results of trial values over time HOT 3
- Conditional sampling in configuration space HOT 4
- Using sigterm / catching sigterm to enable checkpointing HOT 10
- Convenience transformation for config spaces HOT 8
- Docs for continuing aborted runs HOT 12
- Hard to find default configurations for schedulers HOT 3
- Difficulties setting rungs / stopping HOT 20
- GP not robust to NaN metric HOT 2
- Direct support for time as a resource? HOT 7
- Acquisition functions in Bayesian optimization HOT 1
- Update Ray dependencies, as dependabot flags them as security vulnerabilities
- Set custom GPU Ids for LocalBackend HOT 2
- [Question] Multiple runs for same parameter values HOT 5
- ModuleNotFoundError: No module named 'sagemaker.interactive_apps' HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from syne-tune.