Comments (7)
I worked on a fix: d9759f6
I think it solves this issue.
The only thing to mention (and I believe this already did not work before) is that I could not make create/copy drivers
work for block-output (like in HLPS). If full files are written, it works, however (like the OVV images in L2PS).
from force.
I wonder what I changed... I guess I will need to implement the CSO fix in each sub-module
from force.
Hey @ernstste, did #26 ever work? I just made a small test, and it doesn't work for TSA and CSO.
I tried to pin down the issue, and problem is, that data for this chunk are neither read, computed, nor written.
I guess that the GeoTiff is sparse, though I do not understand yet why this worked in the past.
from force.
Damn
from force.
This bug was introduced when implementing the custom GDAL options where you can define your own output format and choose your own driver.
Not every driver supports "creating" a dataset, some need to create by copying an existing one. This can be an in-memory dataset, however. And to be most flexible and simplify the code, I followed that strategy for all drivers, i.e.
- create dataset in-memory
- copy dataset to disk
Apparently, this does not work with sparse files somehow... ugh.
I guess I will need to check if the driver can create files, and then work around this by either directly creating or create/copying only if needed.
from force.
Ouch. Custom GDAL options come back to bite you again.
I'm pretty sure #26 did work back then. I tried it right after you implemented the fix and the results looked ok.
from force.
It might be, that the problem does not consistently surface - you also mentioned that you did not see that issue with Landsat data.
from force.
Related Issues (20)
- Potential race condition in force-cube HOT 4
- Optional cirrus buffer HOT 1
- [Documentaton] Texture Metrics, Landscape Metrics, Sampling HOT 2
- RTD is referencing an outdated revision HOT 5
- Projection problem when force-cubing Sentinel-1 images HOT 3
- Apparent data loss when selecting EQUI7-EU as output HOT 4
- MODIS to be decommissioned; is there an alternative? HOT 2
- 24h interaction cooldown for new GitHub users
- Error when downloading Landsat with force-level1-landsat search HOT 10
- Error when using force-level1-landsat search with --forcelogs HOT 2
- Changes in the authorization process for Google Cloud may affect force-level1-csd soon HOT 9
- Level2 - Couldn't open the directory: Input/output error HOT 4
- level-1-landsat-download: Some links seem to be broken HOT 8
- Example command in documentation failing
- Documentation on Read The Docs broken HOT 3
- Sentinel-2 Volume 11 and Volume 12: FORCE differences from sen2cor HOT 2
- [force-l2ps] High number of opened files by the force-l2ps process HOT 2
- force-cube fails when using gdal 3.8.4 because output is redirected
- force-level1-landsat does not download all the found scenes and fails to populate the queue HOT 8
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from force.