[Feature Request] optionally remove an experiment about tensorboardx HOT 12 CLOSED

Well... I can't remove the folder. The TensorBoard locks it down.

rm: cannot remove ‘experiment_name/’: Directory not empty

Not sure if this has anything to do with the fact that my log_dir is on NFS.

from tensorboardx.

Can that be achieved with shutil.rmtree('xp_name') ?
I am curious about the use case lol.

from tensorboardx.

Nope. Not really. As far as I know, TensorBoard will lock down the directory. You will have to shut down the TensorBoard and remove the directory after that. This will create problems when you have a lot of experiments host by the TensorBoard since once it's back online, it will still take time to load all the data saved before.

For most of the time, my experiments have customized names, but there are still some cases I would like to remove a single or a few experiments that are no longer important or simply wrong. Having this feature will simplify the procedure a lot (shut down -> remove directory -> restart -> wait until it loads all previous data).

from tensorboardx.

Have you tried the reload button in tensorboard interface after removing the folder? My tensorboard (1.2.1) handles your situation perfectly. (both adding or removing folder)

from tensorboardx.

Sorry, there might be a misunderstanding.

What I am trying to say is that you can't remove the folder while the TensorBoard is still running. If you shut down the TensorBoard and remove the folder, it will work.

So, I guess the question is: can you remove the folder contains experiment event file, while your TensorBoard is still running?

I am using Tensorflow version 1.3.0 and TensorBoard version 0.1.5, by the way.

from tensorboardx.

HI, I can remove the folder with rm -rf xp_name while tensorboard is running. Also tested on Tensorflow version 1.3.0 and TensorBoard version 0.1.5.

from tensorboardx.

Did you use -rf for the rm command? I think it's much like a OS related problem.

from tensorboardx.

Yes, of course. Thank you for asking though.

from tensorboardx.

Then I think the python script shutil.rmtree('xp_name') will not work as well. btw, mine storage environment is also NFS share.

from tensorboardx.

Yeah, that was the first thing I tried, and then I realized that rm -rf wasn't working as well.

I guess I will try to do some further testing. Thanks for the help!

from tensorboardx.

any update on this issue guys . Same issue here experiments are not deleted using remove_all_experiments(). I don't know why this topic was closed

from tensorboardx.

remove_all_experiments is not provided by tensorboardX. I suggest using command line to remove the folders. The original issue seems OS related (file lock). Feel free to open new issue.

from tensorboardx.