Error in evaluation of a strategy about avalanche-rl HOT 6 OPEN

As you can see in the examples folder to make it work correctly you should write:

strategy.eval(scenario.eval_stream)

@AntonioCarta Should we stick with this name for the test/evaluation stream or should we change it?

from avalanche-rl.

I think test_stream is a better default. Most benchmarks have a train/test split, not a train/eval split.

from avalanche-rl.

As you can see in the examples folder to make it work correctly you should write:

strategy.eval(scenario.eval_stream)

@AntonioCarta Should we stick with this name for the test/evaluation stream or should we change it?

Yes, thank you. Pardon me, now, as I save the checkpoints, I get this error during the evaluation when I use eval_stream:

RuntimeError: Checkpoint file checkpoints/99/checkpoint.pth already exists.

What is the problem? However, I save the checkpoint at end!

from avalanche-rl.

We changed the checkpointing mechanism in the avalanche master because it had some issues. It is also untested with avalanche-RL still, so you may have to wait for the next avalanche release for a stable checkpointing system.

from avalanche-rl.

Thank you so much for your reply. Excuse me, when the next version of Avalanche will be release?

Thanks

from avalanche-rl.

It's planned for the end of June. Avalanche-rl will support the new version soon after the release.

from avalanche-rl.