fraserwg / pvcalc Goto Github PK

When merging with the scripts, the attribute 'tile_number' is added to the new dataset. This needs to be fixed.

Need to get the output to date stamp clearly. E.g. at the start of the script.

Need to implement a script for slicing the PV

I'm currently using thread and processed based parallelism from the python standard library. This requires user input for parallel computation. As I'm using Xarray the natural choice for parallelising the code would be Dask, with each chunk corresponding to a tile.

It would be logical to use dask all the way through - perhaps starting with a mfdataset instead of a list of datasets and performing operation on them one by one. That said, I found that on archer, the process of opening a large mfdataset takes a <> time. Perhaps it would make sense to introduce the Dask based features after the level selection step. I.e. use open_tile on each tile and THEN merge the datasets and use Dask.

Alternatively, if using Dask causes problems, perhaps job lib would be a better, more user friendly way to improve the way the parallelism works.

Tiling appears in the glued PV output. This is because each tile has no overlap with the adjacent tile, so some points on the edge of the grid need extra information passing. We need to add additional information when calculating db/dx, db/dy, dw/dx and dw/dy.