kearney-sp / aop_mosaic Goto Github PK

Data workflow automation (via prefect) to process NEON hyperspectral data into a single mosaic.

1. Download NEON AOP hyperspectral data (DP130006_001)
2. Aggregate metadata file (.json) for the data
3. Apply BRDF and Topographic corrections using HyTools
4. Mosaic flights by selecting pixels with the sensor zenith angle nearest to NADIR
5. Write data to a Zarr file (via xarray)

1. Create a prefect account (Free)
2. Setup Prefect Cloud and Agent environment (see here - https://docs.prefect.io/orchestration/tutorial/overview.html)
3. Setup cloud project and register flow (see here - https://docs.prefect.io/orchestration/tutorial/first.html)
4. Activate flow (configure as necassary) on prefect cloud UI.

Runs On: data_science_im_rs:latest

See: https://github.com/rmg55/aop_mosaic/blob/main/Neon_AOP_flow.ipynb

Prefect Cloud View:

1. Change cluster scaling from static to adaptive
2. Improve performance on mosaic
3. Contact Phil Townsend Lab about BRDF parameters/configurations