Comments (2)
I will look into this some more. When orthorectifying, the geometry lookup table (GLT) included in the location group is used to reshape the data array to fit the GLT dimensions. I think to do that on chunks would require modification of the GLT. My understanding is that chunking along the bands dimension would likely slow down operations focused on imaging spectroscopy since that would require more reads. Maybe @pgbrodrick has some insight?
At minimum we can at least add notes about memory requirements.
from emit-data-resources.
Yes, I tried fiddling with the orthorectification but could not get it to work with dask.array
s. In the version of emit_xarray
I am working with in my project utils/emit_tools.py I specify an option to chunk along the crosstrack and downtrack dims that is only accepted if ortho=False
.
I think this is worthwhile because the recommended workflow is to perform data manipulations and biophysical modelling on the unorthorectified data, and later orthorectify the variables produced downstream. This works for me because the output variables will typically have far fewer variables than the image cube has bands (I go from 250ish bands to 4 endmembers). It then becomes much more feasible to load the data into memory before orthorectifying.
My guess is that this workflow is common enough to warrant accommodating it by specifying a chucking option if ortho=False
from emit-data-resources.
Related Issues (20)
- Need to flip `glt_x`? HOT 13
- Anaconda gets hung up on solving environment HOT 1
- missing .netrc file setup instructions required for direct S3 access HOT 2
- colab
- Package emit_tools.py seperately for pip/conda install
- Clarify difference between tutorial, guide, and how to in readme
- Permission error of accessing S3 data HOT 2
- Emit for the Future - Nasa Space Apps Challenge project
- geotransform and spatial_ref for orthorectification, not original data HOT 3
- How to filter cloud_cover for EMIT data using pystac? HOT 3
- Images with a different crosstrack dimension length HOT 2
- Add information on EMIT file size
- s3 access EMIT data HOT 1
- Keyerror with 'features' in Visualizing Methane Time Series Tutorial HOT 4
- Problem with reading NASA PACE data HOT 6
- convert to ENVI how to clarification
- Add EMIT L2B Mineralogy Tutorial to the Repository Contents Table HOT 1
- Holoviews box
- Holoviews add option for basemap
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from emit-data-resources.