Comments (1)
Need:
- system (gridworld) with logger and animator
- scenario for tabular RL updates
- tabular RL method
Will probably need lookup table model. Actor and critic are tables. Learning via policy iteration and value iteration -- see S&B, p. 74 book.
Scenario: one iteration is processing of the whole state space (gridworld).
Need terminal state. So, optimal policy is a set of arrows for each cell indicating how to optimally reach the target.
Each cell has negative reward, some cells have lower negative rewards than others.
Only target (terminal) state has positive reward.
Need animation like 3wrobot, but left upper corner: gridworld itself, arrows show optimal actions, cells with colors from red to green indicating low and high reward. Numbers in cells = values
No stochastics needed. Just deterministic gridworld. For an example, see frozen lake
from rcognita.
Related Issues (20)
- Create a CI with github actions
- Sampling-best optimization method
- Turn callback into a method
- Refresh the documentation
- CASADI integration
- Environment configuration is very inconvenient
- Allow to read configs from txt files
- In ctrl_selector some ideologically wrong arguments are passing. Crutch HOT 1
- NN model
- Estimate SS model move out of controllers HOT 1
- NN estimator in estimators module
- Scenarios module HOT 1
- Implement new naming HOT 1
- Make logger generic HOT 1
- Implement Monte-Carlo method and pipeline
- Polish code architecture, make sure it's all done HOT 1
- Test everything, incl. the case when N_actor=0
- Architecture refactoring
- torch engine
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from rcognita.