Comments (11)
I can confirm that both s3fs and rclone don't work, apparently the mount command fails. Sadly geesefs doesn't support chmod.
from k8s-csi-s3.
@vitalif do you know, if there's an option for geesefs to ignore chmod/chown errors, if it's not supported?
from k8s-csi-s3.
Hi. Why did you need two issues for this?)
I don't recommend using s3fs and rclone, s3fs is slow, rclone is even worse, sometimes it just hangs.
So I'll probably remove them from README.
Support is still there in the code by the way, so you can try to use it if you build your own docker image with s3fs and/or rclone, you just have to change mounter and options.
from k8s-csi-s3.
Hi. Why did you need two issues for this?)
I had unsuccessfully tried to run k8s-csi-s3 with s3fs and rclone. So I needed examples to make it work. However when I looked into the code it seemed that s3fs/rclone are not supported at all. The lack of support seemed as related issue but not the same one. Therefore I've created 2 separate issues. Anyway, fill free to close the first one.
I don't recommend using s3fs and rclone, s3fs is slow, rclone is even worse, sometimes it just hangs.
I had the 'hanging' with geesefs
. I think there are memory leaks in geesefs but I'm not sure. So I wanted to try out alternatives
from k8s-csi-s3.
Ok, I changed Dockerfile to include both s3fs and rclone, they should also work in 0.31.3 now.
What problems did you have with geesefs, by the way? Can you file an issue?
from k8s-csi-s3.
What problems did you have with geesefs, by the way? Can you file an issue?
@vitalif I use geesefs to mount S3 buckets inside managed kubernetes cluster in Yandex Cloud. Sometimes when I do massive I/O operations my pods just hang until I reboot them. I presumed there may be problems with geesefs
implementation and I tried other alternatives. Hence, this issue about s3fs and rclone support.
Anyway, I tried s3fs and rclone and I get the same problems: sometimes pods just hang during I/O operations. Probably I just use s3 in unintended way (basically as a usual file system).
from k8s-csi-s3.
Is there a way to reproduce it? I can try to fix it if it's reproducible. Which massive operations exactly do you perform before hangs?
from k8s-csi-s3.
Hi @vitalif , s3fs works well in 0.31.3, but cannot work in 0.35.5, it report fuseMount command error.
My k8s is on EKS with bottle rocket os, and I cannot use geesefs for now, because somehow errors report that SElinux rejcted it.
Could you please help? thanks.
from k8s-csi-s3.
@vitalif, I am also trying to change the last modified date of a folder inside the bucket but It is not working in geesefs, and in s3fs and rclone mount commands are not working.
from k8s-csi-s3.
It ignores them, it only returns "operation not supported" on the root directory of mountpoint (i.e. mountpoint itself)
from k8s-csi-s3.
@vitalif chmod also does not work on subfolders - see #131
it would be really great if the s3fs mounter works as a fallback
from k8s-csi-s3.
Related Issues (20)
- Image "quay.io/k8scsi/csi-node-driver-registrar:v1.2.0" should be updated
- Does s3fs support virtual style? HOT 1
- kubelet floods the logs
- Regarding the problem of repeated creation and hanging of pvc HOT 3
- certificate signed by unknown authority HOT 3
- PVC created by storageclass does not support capacity expansion HOT 2
- Readme: support for RWX? HOT 1
- typo? region or endpoint
- Transport endpoint is not connected
- Volume mount is failing with time out error - if CRI is containerd HOT 1
- [0.41.1] after node crash csi-s3 fails umounting a not mounted directory
- exec /csi-node-driver-registrar: exec format error HOT 2
- Feature Request: Let StorageClass automatically create paths based on namespace and name (and offer them to stay even if the PVC is deleted)
- error getting deleter volume plugin for volume "csi-s3-manual": no deletable volume plugin matched
- static PersistentVolume with s3fs fails immediately on initial mount HOT 1
- chmod fails in geesefs - also for subfolders HOT 1
- BUG: volume mounted as root:root despite options are set otherwise HOT 3
- transport endpoint is not connected HOT 1
- [Bug] A new pod attaches to the dying systemd unit
- Cannot create S3 volume on ceph, having "The provided 'x-amz-content-sha256' header does not match what was computed." error HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from k8s-csi-s3.