hpcleuven / vsc-python-irodsclient Goto Github PK

When doing a put of a file that already exist in iRODS the irods.bulk.put() function overwrite the file without any warning or information.

That seems to be also the behaviour of the PRC session.data_objects.put() but it might be better to raise an error and suggest using the force option.

I do not see otherwise what is the purpose of the force option if the default is to overwrite the file

In the same line as the bulk operation for get and put that already exist it will be nice to also have a move bulk operation.
It should be based on the PRC functions:

session.data_objects.move
session.collections.move

but also adding wildcards and AVUs.

When executing a vsc-prc-size command in a directory I get an error and the size of a file that does not exist in this directory.
The directory I am using:

/kuleuven_tier1_pilot/home/vsc30706/testcol:
10G.dat
10M.dat
1G.dat
1M.dat
C- /kuleuven_tier1_pilot/home/vsc30706/testcol/500GB-in-large-files
C- /kuleuven_tier1_pilot/home/vsc30706/testcol/50GB-in-medium-files
C- /kuleuven_tier1_pilot/home/vsc30706/testcol/5GB-in-small-files
C- /kuleuven_tier1_pilot/home/vsc30706/testcol/5MB-in-tiny-files
C- /kuleuven_tier1_pilot/home/vsc30706/testcol/Climate-Huge
C- /kuleuven_tier1_pilot/home/vsc30706/testcol/Climate-Large
C- /kuleuven_tier1_pilot/home/vsc30706/testcol/Climate-Medium
C- /kuleuven_tier1_pilot/home/vsc30706/testcol/Climate-Small

Whe I execute vsc-prc-size -H -r "./*.dat"

I get as result:

93G ./100G.dat
Traceback (most recent call last):
File "/apps/leuven/common/software/vsc-python-irodsclient/development/vsc-python-irodsclient/tools/vsc-prc-size", line 52, in
for path, size in iterator:
File "/apps/leuven/common/software/vsc-python-irodsclient/development/vsc-python-irodsclient/lib/vsc_irods/manager/bulk_manager.py", line 430, in size
assert len(results) == 1
AssertionError

The verification that I am in the right directory:
ipwd
/kuleuven_tier1_pilot/home/vsc30706/testcol

The file 100G.dat does not exist in this directory (but it does exist in my home):

ils
/kuleuven_tier1_pilot/home/vsc30706:
100G.dat
100M.dat
10G.dat
10M.dat
1G.dat
1M.dat
50M.dat
CTBY_a_n.nc