Poor copy/sync speed from a NFS-mounted directory to Ceph S3 bucket about rclone HOT 3 OPEN

rclone copy file in nfs-mounted dir to ceph bucket:

rclone copy file in local filesystem to ceph bucket:

cp nfs-mounted to ceph s3-mounted:

from rclone.

I suggest you try experimenting with these flags

 --s3-upload-concurrency int   Concurrency for multipart uploads and copies (default 4)
 --s3-chunk-size SizeSuffix   Chunk size to use for uploading (default 5Mi)

Making them larger will help a lot at the cost of more memory usage.

from rclone.

I suggest you try experimenting with these flags

 --s3-upload-concurrency int   Concurrency for multipart uploads and copies (default 4)

 --s3-chunk-size SizeSuffix   Chunk size to use for uploading (default 5Mi)

Making them larger will help a lot at the cost of more memory usage.

Thanks, I will try this.

from rclone.