Comments (8)
Confushion
commented on June 24, 2024
I've got similar issues (on OVH/hubic).
It seems that the maximum segment size (default mount option segment_size=256) doesn't work as expected. Any file larger than the maximum segment size is not properly split into multiple segments.
If you mount with option segment_size=10 you will observe the error a lot earlier at an upload of 10Mb.
This currently limits the maximum file size to be about 5Gb (the maximum size of a segment), when mounted with option segment_size=5120.
As I have a lot of files > 5Gb that I'd like to store on Hubic, this is a blocker for me...
from svfs.
pisto
commented on June 24, 2024
Getting the same issue, also with the suggested rsync method. Basically all files greater that the segmententation limit are broken. Endpoint is hubic.
from svfs.
xlucas
commented on June 24, 2024
Can you provide a debug trace ? I suspect this is a duplicate of #100.
from svfs.
pisto
commented on June 24, 2024
How do I generate it?
from svfs.
xlucas
commented on June 24, 2024
Use the debug mount option documented here.
from svfs.
pisto
commented on June 24, 2024
DEBU[2017-09-22T13:58:29+02:00] <- Lookup [ID=0xa2 Node=0x2 Uid=1000 Gid=1000 Pid=22793] "rick.mkv" source=fuse
DEBU[2017-09-22T13:58:29+02:00] -> [ID=0xa2] Lookup error=ENOENT source=fuse
DEBU[2017-09-22T13:58:29+02:00] <- Create [ID=0xa3 Node=0x2 Uid=1000 Gid=1000 Pid=22793] "rick.mkv" fl=OpenWriteOnly+OpenCreate mode=-rw------- umask=--------w- source=fuse
DEBU[2017-09-22T13:58:30+02:00] -> [ID=0xa3] Create {0x3 gen=0 valid=1m0s attr={valid=1m0s ino=12768038556851320042 size=0 mode=-rwx------}} {0x1 fl=OpenDirectIO+OpenNonSeekable} source=fuse
DEBU[2017-09-22T13:58:30+02:00] <- Write [ID=0xa4 Node=0x3 Uid=1000 Gid=1000 Pid=22793] 0x1 131056 @0 fl=WriteLockOwner lock=6900770311377782222 ffl=OpenWriteOnly source=fuse
DEBU[2017-09-22T13:58:30+02:00] -> [ID=0xa4] Write 131056 source=fuse
DEBU[2017-09-22T13:58:30+02:00] <- Write [ID=0xa5 Node=0x3 Uid=1000 Gid=1000 Pid=22793] 0x1 131072 @131056 fl=WriteLockOwner lock=6900770311377782222 ffl=OpenWriteOnly source=fuse
DEBU[2017-09-22T13:58:30+02:00] -> [ID=0xa5] Write 131072 source=fuse
DEBU[2017-09-22T13:58:30+02:00] <- Write [ID=0xa6 Node=0x3 Uid=1000 Gid=1000 Pid=22793] 0x1 16 @262128 fl=WriteLockOwner lock=6900770311377782222 ffl=OpenWriteOnly source=fuse
DEBU[2017-09-22T13:58:30+02:00] -> [ID=0xa6] Write 16 source=fuse
DEBU[2017-09-22T13:58:30+02:00] <- Write [ID=0xa7 Node=0x3 Uid=1000 Gid=1000 Pid=22793] 0x1 131056 @262144 fl=WriteLockOwner lock=6900770311377782222 ffl=OpenWriteOnly source=fuse
DEBU[2017-09-22T13:58:30+02:00] -> [ID=0xa7] Write 131056 source=fuse
[...]
DEBU[2017-09-22T13:59:20+02:00] <- Write [ID=0xc9c Node=0x3 Uid=1000 Gid=1000 Pid=22793] 0x1 131072 @267780080 fl=WriteLockOwner lock=6900770311377782222 ffl=OpenWriteOnly source=fuse
DEBU[2017-09-22T13:59:20+02:00] -> [ID=0xc9c] Write 131072 source=fuse
DEBU[2017-09-22T13:59:20+02:00] <- Write [ID=0xc9d Node=0x3 Uid=1000 Gid=1000 Pid=22793] 0x1 16 @267911152 fl=WriteLockOwner lock=6900770311377782222 ffl=OpenWriteOnly source=fuse
DEBU[2017-09-22T13:59:20+02:00] -> [ID=0xc9d] Write 16 source=fuse
DEBU[2017-09-22T13:59:20+02:00] <- Write [ID=0xc9e Node=0x3 Uid=1000 Gid=1000 Pid=22793] 0x1 131056 @267911168 fl=WriteLockOwner lock=6900770311377782222 ffl=OpenWriteOnly source=fuse
DEBU[2017-09-22T13:59:20+02:00] -> [ID=0xc9e] Write 131056 source=fuse
DEBU[2017-09-22T13:59:20+02:00] <- Write [ID=0xc9f Node=0x3 Uid=1000 Gid=1000 Pid=22793] 0x1 131072 @268042224 fl=WriteLockOwner lock=6900770311377782222 ffl=OpenWriteOnly source=fuse
DEBU[2017-09-22T13:59:21+02:00] -> [ID=0xc9f] Write 131072 source=fuse
DEBU[2017-09-22T13:59:21+02:00] <- Write [ID=0xca0 Node=0x3 Uid=1000 Gid=1000 Pid=22793] 0x1 16 @268173296 fl=WriteLockOwner lock=6900770311377782222 ffl=OpenWriteOnly source=fuse
DEBU[2017-09-22T13:59:21+02:00] -> [ID=0xca0] Write 16 source=fuse
DEBU[2017-09-22T13:59:21+02:00] <- Write [ID=0xca1 Node=0x3 Uid=1000 Gid=1000 Pid=22793] 0x1 131056 @268173312 fl=WriteLockOwner lock=6900770311377782222 ffl=OpenWriteOnly source=fuse
DEBU[2017-09-22T13:59:21+02:00] -> [ID=0xca1] Write 131056 source=fuse
DEBU[2017-09-22T13:59:21+02:00] <- Write [ID=0xca2 Node=0x3 Uid=1000 Gid=1000 Pid=22793] 0x1 131072 @268304368 fl=WriteLockOwner lock=6900770311377782222 ffl=OpenWriteOnly source=fuse
DEBU[2017-09-22T13:59:21+02:00] -> [ID=0xca2] Write 131072 source=fuse
DEBU[2017-09-22T13:59:21+02:00] <- Write [ID=0xca3 Node=0x3 Uid=1000 Gid=1000 Pid=22793] 0x1 16 @268435440 fl=WriteLockOwner lock=6900770311377782222 ffl=OpenWriteOnly source=fuse
DEBU[2017-09-22T13:59:21+02:00] -> [ID=0xca3] Write 16 source=fuse
DEBU[2017-09-22T13:59:21+02:00] <- Write [ID=0xca4 Node=0x3 Uid=1000 Gid=1000 Pid=22793] 0x1 131056 @268435456 fl=WriteLockOwner lock=6900770311377782222 ffl=OpenWriteOnly source=fuse
DEBU[2017-09-22T13:59:39+02:00] -> [ID=0xca4] Write error=EIO: Timeout when reading or writing data source=fuse
DEBU[2017-09-22T13:59:39+02:00] <- Write [ID=0xca5 Node=0x3 Uid=1000 Gid=1000 Pid=22793] 0x1 131056 @268435456 fl=WriteLockOwner lock=6900770311377782222 ffl=OpenWriteOnly source=fuse
DEBU[2017-09-22T13:59:54+02:00] -> [ID=0xca5] Write error=EIO: Timeout when reading or writing data source=fuse
DEBU[2017-09-22T13:59:54+02:00] <- Flush [ID=0xca6 Node=0x3 Uid=1000 Gid=1000 Pid=22793] 0x1 fl=0x0 lk=0x5fc476094e3c05ce source=fuse
DEBU[2017-09-22T13:59:54+02:00] -> [ID=0xca6] Flush source=fuse
DEBU[2017-09-22T13:59:54+02:00] <- Release [ID=0xca7 Node=0x3 Uid=0 Gid=0 Pid=0] 0x1 fl=OpenWriteOnly rfl=0 owner=0x0 source=fuse
DEBU[2017-09-22T13:59:54+02:00] -> [ID=0xca7] Release source=fuse
from svfs.
xlucas
commented on June 24, 2024
Try setting connect_timeout=5m like suggested in #100
from svfs.
fungiboletus
commented on June 24, 2024
Hei. I will try that, but doesn't that mean the underlying system has a slowness issue ?
from svfs.
Related Issues (20)
- Suggestion: docker volume plugin HOT 1
- SVFS open flags
- gpg says iobuf_write failed HOT 1
- installation on ubuntu 10.04 won't work HOT 2
- As vmail?
- Windows server 2012 R2 samba copied files 0kb in size HOT 2
- File ownership in rpm
- Cannot mount a pcs container and a Hubic account on the same host (Linux) HOT 1
- svfs & borg
- unable to rsync
- svfs encryption: what happened exactly? HOT 1
- May I ask if I can control dangerous instructions? HOT 1
- Is svfs still supported by OVH ? HOT 6
- installation svfs-0.9.1-1.x86_64 HOT 1
- not synchronize in any way
- Inodes disk are always full
- OVH: Deletion of endpoints for Object Storage and Cloud Archive HOT 2
- Keystone API v2 deprecated, v3 doesn't work HOT 3
- Lookup error=ENOENT
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from svfs.