How to use ACE algorithm in my own environment? about ace HOT 4 CLOSED

I apologize for replying to your question so late.

ACE is implemented based on DI-engine, and you can read some DI-engine (https://github.com/opendilab/DI-engine) documentation to learn how to use it.

The three most important files in the entire repository are:

• model: https://github.com/opendilab/ACE/blob/main/ding/model/template/smac_ace.py which includes how to embed the SE-state.

• policy: https://github.com/opendilab/ACE/blob/main/ding/policy/ace_dqn.py The forward_learn function includes the logic for learning, forward_collect contains the logic for collecting data, and forward_eval contains the logic for testing.

Thank you very much for your interest in our work. If you have any questions, please feel free to continue this conversation. I have set issue reminders to strong reminders.

from ace.

If there is any config.py you can provide?

from ace.

If there is any config.py you can provide?

In which environment do you wish to deploy ACE algorithms: SMAC, GRF, or other environments?

from ace.

GRF

from ace.