Comments (3)
Which objective metric you used to observe skipping bitrate 2 and 4? Notice in figure 3(b) and section 3 example 2, this behavior might be desirable.
About picking the model forward, we didn't experience 2k model significantly outperforms 20k in validation. Usually the more you train it, the better the performance, unless there is significant overfitting
from pensieve.
QoE linear was the metric used right? I am referring to the pretrain model that you provided with the code. Just as shown in the figures 3a/3b the model only chooses from qualities 4.3mbps / 1.8mbps / 750mbps / 300kbps, while skipping the qualities 2 and 4.
It is indeed performing slightly better than other models that I've tried training (which dont ignore those bitrates), but I want to know if there is some intuition/methodology behind achieving such behaviour?
This is the process I am using for training/validation.
- Start the training with entropy X (e.g. 1). Keep printing the test results every 100 epochs (during model saving).
- If the test results are >= max, store that model separately as the new best model.
- Continue for 30k iterations. Use the best model as the base for next 30k iterations with a lower entropy.
I am using the provided training and testing sets for the above. Is there something I am missing? Coz I am getting my "best model" sometimes as early as 8k iterations out of 30k iterations. And at other times it might be at 28k iterations. Unlikely for overfitting, since the results are oscillating near max values, which shouldn't occur if there is overfitting right?
from pensieve.
Thanks for pointing this out but we didn't notice this behavior before. One intuition I can think of is this might reduce the variance for the policy (outputting just a subset of the actions). So as long as the performance is improved, the agent has all the correction intention of reduce its entropy for a subset of the actions. This might not be preferable in reality, and I think you might want to increase the training dataset to get rid of this issue.
As for the overfitting, based on what you described, it might not be an overfitting issue. But you might want to checkpoint the model and test on validation set at each step to make sure.
from pensieve.
Related Issues (20)
- Unable to run real experiment HOT 4
- How Paper input matches the code state s(t)? HOT 3
- no logs found in result folder (possibly CORS issue) HOT 1
- k = 8 past bandwidth and Next chunk sizes HOT 2
- cross-validation curve HOT 1
- fixed_env vs env HOT 1
- FCC traces generation
- qoe on paper
- Dropbox error HOT 2
- problem about run run_all_traces.py
- problem about Mahimahi format
- code for figure 10
- Question about parameter TOTAL_VIDEO_CHUNK HOT 1
- Unexpected results of real-world experiment
- Chrome retry logs for both real experiments and run experiments HOT 1
- a student search for help ( real_Exp empty folder) HOT 1
- links for sample data is not working HOT 1
- Unable to start ABR, only first chunk plays HOT 2
- Unable to watch the video with my browser HOT 1
- mahimahi makes selenium not work
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pensieve.