alirezakazemipour / ddpg-her Goto Github PK
View Code? Open in Web Editor NEWImplementation of the Deep Deterministic Policy Gradient and Hindsight Experience Replay.
Implementation of the Deep Deterministic Policy Gradient and Hindsight Experience Replay.
Excuse me, I ran your code, but after 30 epochs, the success_rate still 0, is there anything in the code needs modify?
Thanks
Hello,
I have a question of fetchreach_env.
In fetchreach_env,i don't konw the gripper_vel and gripper_state really mean,because the gripper doesn't need to open or close.Mabye those obs are useful in pickandplace_env.
And I try change obs in fetchreach_env.
Like this :obs = grip_pos.
Just the coordinates of the grip,and exclude the gripper_vel and gripper_state, then I use HER to train a model ,the success rate after 10 epochs is 1.
So, in fetchreach_env do I really need the gripper_vel or gripper_state.
Thank you.
Hello, have you made any changes to the pickplace environment itself? I used DDPG+HER in stable-baseline3 and did not train the results. The reward of the environment itself is only the distance between the target point and the object, which is very simple
Hi, thanks for providing this code. I failed to reproduce the result you have achieved with the updated environment from gymnasium Robotics and I observed the success rate remains around 0. I have modified the code a little bit so it matches the updated environment, and I tested the code with fetchReach-v2 which works well. I'm wondering what aspects I should investigate? or Perhaps you've encountered a similar challenge in the past and could offer some pointers. Thanks for your help!!!!!
First of all, thank you very much for writing a pytorch implementation of DDPG+HER.
I found that this implementation works very well for all of the Fetcher environments available in gym.
Example: FetchPickAndPlace-v1
However, using the same approach for the Hand environments doesn't seem to work as well.
Example: HandManipulateEgg-v0
It's understandable that the performance wouldn't be as good since the Hand environments seem more difficult than the Fetcher environments. I was hoping that I could increase the success rate by increasing the number of epochs, but the problem at hand doesn't seem to be that simple.
Does anyone have any suggestions for how to improve the current repository so that it achieves a higher success rate for the Hand environments?
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.