s3fs and rclone support about k8s-csi-s3 HOT 11 OPEN

I can confirm that both s3fs and rclone don't work, apparently the mount command fails. Sadly geesefs doesn't support chmod.

from k8s-csi-s3.

@vitalif do you know, if there's an option for geesefs to ignore chmod/chown errors, if it's not supported?

from k8s-csi-s3.

Hi. Why did you need two issues for this?)
I don't recommend using s3fs and rclone, s3fs is slow, rclone is even worse, sometimes it just hangs.
So I'll probably remove them from README.
Support is still there in the code by the way, so you can try to use it if you build your own docker image with s3fs and/or rclone, you just have to change mounter and options.

from k8s-csi-s3.

Hi. Why did you need two issues for this?)

I had unsuccessfully tried to run k8s-csi-s3 with s3fs and rclone. So I needed examples to make it work. However when I looked into the code it seemed that s3fs/rclone are not supported at all. The lack of support seemed as related issue but not the same one. Therefore I've created 2 separate issues. Anyway, fill free to close the first one.

I don't recommend using s3fs and rclone, s3fs is slow, rclone is even worse, sometimes it just hangs.

I had the 'hanging' with geesefs. I think there are memory leaks in geesefs but I'm not sure. So I wanted to try out alternatives

from k8s-csi-s3.

Ok, I changed Dockerfile to include both s3fs and rclone, they should also work in 0.31.3 now.
What problems did you have with geesefs, by the way? Can you file an issue?

from k8s-csi-s3.

What problems did you have with geesefs, by the way? Can you file an issue?

@vitalif I use geesefs to mount S3 buckets inside managed kubernetes cluster in Yandex Cloud. Sometimes when I do massive I/O operations my pods just hang until I reboot them. I presumed there may be problems with geesefs implementation and I tried other alternatives. Hence, this issue about s3fs and rclone support.

Anyway, I tried s3fs and rclone and I get the same problems: sometimes pods just hang during I/O operations. Probably I just use s3 in unintended way (basically as a usual file system).

from k8s-csi-s3.

Is there a way to reproduce it? I can try to fix it if it's reproducible. Which massive operations exactly do you perform before hangs?

from k8s-csi-s3.

Hi @vitalif , s3fs works well in 0.31.3, but cannot work in 0.35.5, it report fuseMount command error.
My k8s is on EKS with bottle rocket os, and I cannot use geesefs for now, because somehow errors report that SElinux rejcted it.
Could you please help? thanks.

from k8s-csi-s3.

@vitalif, I am also trying to change the last modified date of a folder inside the bucket but It is not working in geesefs, and in s3fs and rclone mount commands are not working.

from k8s-csi-s3.

It ignores them, it only returns "operation not supported" on the root directory of mountpoint (i.e. mountpoint itself)

from k8s-csi-s3.

@vitalif chmod also does not work on subfolders - see #131
it would be really great if the s3fs mounter works as a fallback

from k8s-csi-s3.