Comments (7)
Ok sounds good. Thanks for clarifying.
Gonna store this here for safekeeping so I know where to look when I have time to work on this.
Reproducible results with Keras.
from talos.
I unfortunately do not. However, I know someone who might. Will get back to you 👍
from talos.
Unfortunately, no luck. I think this is a very complicated problem and finding the local minima of the hyperparameter space, so to speak, is not trivial.
On the other hand, there is a way to get reproducible results during development using Keras. What we could do is agree on a "good enough" result as a benchmark, initialize the same way every time to ensure the answer is the same.
from talos.
I think so. Regarding "good enough" I think that's quite important here >> the goal of an experiment is to find "good enough" model and once a given number of those models is found, the experiment can proceed to the steps we had discussed in #40. For example, somebody training a model for sentiment classification...good enough really can't be more than 90% as even human coders will disagree at about that rate (10% disagreement). So the first step would be to find "good enough" depending on the use-case (so user will input) and then the next step is to work on finding the best of many options at the good enough level where best now means generalization.
from talos.
For sure. And I think for the purposes of unit-checking Scan
(I'm using the term "unit" quite flexibly here... Scan
is many units!) I think this will be suitable.
I will consider this my next project here since I can do it more or less independently of Reporting
. Are all the branches (dev, master, daily-dev) compatible right now and if not do you have a recommended branch to start working from?
Also I apologize for my lack of contributions as late. I've been completely slammed.
from talos.
@x94carbone Great :) I think we should merge dev with master at this point, to make sure all is in sync and then from master to daily-dev. I will create the pr.
from talos.
@x94carbone there was some issues in dev that had passed tests, but it's now fixed and dev and daily-dev are in sync and master has nothing new compared to dev.
from talos.
Related Issues (20)
- Key duplication results in exception: param dict vs. csv file stored (e.g., 'loss') HOT 3
- Heatmap always have missing parts HOT 2
- Failed to build scipy while installing talos HOT 1
- Using `Evaluate` with multiple inputs HOT 6
- ImportError: cannot import name 'get_config' HOT 4
- add arguments to the function syntax HOT 1
- Using train, val data HOT 1
- Cannot replicate typical example from documentation HOT 1
- Can't find description of layer shapes HOT 3
- Talos installation stuck at downloading statsmodel HOT 1
- [RFC00102] Increase Visibility and Access to Power Draw Data HOT 1
- Getting errors when handling custom object HOT 4
- Add comprehensive support for n-dimensional `x` or `y`
- AttributeError: module 'talos.utils' has no attribute 'ExperimentLogCallback' HOT 1
- Live is not in talos HOT 1
- Advanced hyperparameter configuration HOT 1
- Error with Autom8 import HOT 1
- pip install talos is failing due to sklearn in requirements.txt instead of scikit-learn HOT 4
- Will talos support Maximal Update Parametrization later? HOT 1
- batch_size not support list HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from talos.