Incorporate other derived EUMETSAT data about satflow HOT 8 OPEN

Work on atmospheric motion vectors (AMVs) and 3D winds is still in progress and motivated by this interpolation study. The interpolation uses flow vectors and visibility maps, and hence the flow vectors are not perfect, though there is certainly a positive correlation. Much more work needs to be done to translate these flows into a physical measurement.

3D winds and AMVs are currently the largest source of uncertainty in numerical weather prediction and data assimilation systems (ie. initializing PDEs are important). I'm working with colleagues from GMAO/NOAA to build models for both flows and cloud height (AMVs need both). So far, results definitely seem to outperform traditional approaches, NOAA/EUMETSAT use similar techniques. It's quite a tricky problem though, there are sparse observations of ground truth winds, unsupervised approaches have not worked yet for me, and cloud heights need to be estimated.

from satflow.

Also has an instability product for the atmosphere at a per pixel level for Europe, so including that could potentially lead to better understanding of where the clouds start to form or disappear in, and could be very helpful for the model, I think

from satflow.

I might have misunderstood, but I think @tjvandal's 2019 paper "Optical Flow for Intermediate Frame Interpolation of Multispectral Geostationary Satellite Data" demonstrates that an ML-based optical flow model does a better job of inferring wind motion vectors from satellite imagery than conventional motion vector algorithms :)

(But, even if I've understood correctly, I definitely don't want to stop you trying out the EUMETSAT motion vector product(s)!)

from satflow.

Ah okay, I'll check that out!

from satflow.

Awesome, thanks loads for the details, @tjvandal!

from satflow.

Update: Just finally got the data from eumetsat for nearly all the derived products for RSS, so now can start seeing if including them helps. Some are more temporally sparse, and are only released every 15, 20 or 30 minutes.

from satflow.

Satpy does not currently load the Regional or Atmospheric motion vector BUFR products... pytroll/satpy#1768 hoping that can be fixed soon.

from satflow.

Finally got regional motion vector products for about 6 months of data

from satflow.