pauleve / donodo Goto Github PK

Currently the upload is done in two stages: the image is exported and zipped to a local temporary file, and then uploaded on zenodo.
It would be great to be able to stream directly online, however, it currently fails with Zenodo reporting File is smaller than expected

Test:

donodo push my/image:tag --compression-mode gzip-pipe

In a nutshell, the bug seems related to the put request which fails with streamed file objects:

# working:
with open("myfile","rb") as fp:
    session.put(f"{bucket}/myfile", data=fp)
# fails with File is smaller than expected:
with Popen(["cat", "myfile"], stdout=PIPE) as p:
    session.put(f"{bucket}/myfile", data=p.stdout)

Any hint welcomed

The current code should easily allow supporting custom templates (supplied in a JSON file for instance) for filling the Zenodo deposition