Comments (3)
I guess it makes sense. I initially went with S,S,A notation since the Matlab MDP Toolbox did it, and I was trying mostly to maintain code conventions. Do you know of other projects that adopt a S,A,S interface?
from ai-toolbox.
Actually I don't. Cassandra's code seems to use A,S,S (no pun intended) but it looks more like a struct than a multi-dimensional array in his code.
However, everybody seems to follow his convention with something like an array of |A| matrices |S|^2.
This also makes sense.
It's your call :)
Do we use more often know "a" without knowing "s" (so A,S,S) or "s" without knowing "a" (so S,A,S) to be able to use the minimal size structure.
I mean, if we use S,A,S and we know only "a" we have to keep the whole thing whereas with A,S,S we can just keep T[a].
It's not an issue in Matlab since you can get T[:,a,:](or something like that).
from ai-toolbox.
Well, what the interface exposes concerning the order of S,A,S' (for example in MDP::Model::getTransitionProbability) is independent from the actual implemementation, so if how the data is handled is a concern you just need to provide your own implementation of a model and all would be well. However, I am going to change it to S,A,S' both in the interface and the implementation, so that then we can operate on each probability vector more efficiently.
from ai-toolbox.
Related Issues (20)
- Python module problem HOT 26
- Using the Toolbox to solve the Tag problem HOT 4
- Save POMDP policy HOT 6
- Sparse Matrix's on POMDP model HOT 22
- Improve serialization for MDP and POMDP Sparse Models HOT 1
- Problem with make HOT 5
- Make cannot find .hpp file in Boost HOT 2
- Errors when compiling tutorials HOT 5
- Can't find Lpsolve when run cmake HOT 9
- Using AI-Toolbox with OMNeT++ HOT 2
- Make issue HOT 9
- Not able to find "compare" file HOT 3
- Trouble installing and running AIToolbox HOT 9
- about LP_Solve HOT 13
- error C3779: 'AIToolbox::IndexMapIterator<IdsIterator,Container>::operator *': a function that returns 'auto' cannot be used before it is defined HOT 11
- Better Project Setup Tutorial HOT 6
- C++: error: expected โ)โ before โelementsNโ HOT 10
- Problems when building the library HOT 4
- Sparse Matrix: Space Time Complexity while assigning and accessing an element. HOT 1
- Can't build because of lpslove HOT 16
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ๐๐๐
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google โค๏ธ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ai-toolbox.