Any way to have CheckpointManager write earlier checkpoints? about orbax HOT 2 CLOSED

If you want all the checkpoints starting from 0, it sounds like you should not be using max_to_keep at all, but setting it to None so no checkpoints are deleted?

I think probably the issue is that the earlier steps (0, 3000, etc.) are not getting saved at all because they are earlier than the existing steps, and thus out of sequence. Can you check ckpt_mngr.should_save(0)? I would expect this to return false. You can force a save on this step using ckpt_mngr.save(0, state, force=True). Note that you would still get an error with force if the checkpoint already exists. And force would also override the interval, so you would get checkpoints 1000 and 2000, etc.

from orbax.

Ahh, yeah, I suspected that orbax might have a rule that it doesn't save a checkpoint if a later one exists. As far as I know it isn't documented though, so I wanted to make sure things were working as expected. In any case, this isn't much of an issue - I used force=True and it works fine. Thanks for the response.

from orbax.