Terminating episode early about mindmaker HOT 4 OPEN

On Mon, Sep 26, 2022 at 2:25 PM Ross Walker ***@***.***> wrote: I'm setting the done flag when I reach an early termination event with the expectation that the episode will end. I track the number of steps and episodes within UE but it seems even after setting the done flag to true and passing it back through mindmaker, the episode continues until the defined number of timesteps is complete - how can I terminate early? I'm using PPO2. — Reply to this email directly, view it on GitHub <#24>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABI6N2L22FKENGOXM3WNSIDWAHTBPANCNFSM6AAAAAAQWBU3XY> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>

On Tue, Sep 27, 2022 at 11:36 AM Ross Walker ***@***.***> wrote: I'm not talking about terminating the program, 'done' is about finishing the episode as far as I understand it? On further inspection...setting the done flag in mindmaker is doing something, the summary printout includes additional line items when using done to terminate an episode early, notably 'average num steps per episode' which is less than n_steps 256 that is set in the params. I was getting thrown off because I was expecting to see that summary printout after every episode ends but it appears it happens after n_steps regardless of early termination which could make sense. Early terminated episodes also don't show up in tensorboard, maybe because the reward is set to 0? — Reply to this email directly, view it on GitHub <#24 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABI6N2N7D2G34IORXZVXYMLWAM5BLANCNFSM6AAAAAAQWBU3XY> . You are receiving this because you commented.Message ID: ***@***.***>