Comments (5)
Yep. I will look into it. There is probably even a xr built in function that does something like chunking.
from climpred.
@aaronspring , there is chunking for xarray: http://xarray.pydata.org/en/stable/generated/xarray.Dataset.chunk.html
Which is why I was confused on our call how this chunking differs. If it is actually different than dask/xarray chunking we should probably use different language.
from climpred.
my chunking function is definately different.
the gist of what it does:
- number_chunks=True: it breaks a dataset with dimension dim into N pieces into a new dataset with dimensions dim and c.
- chunk_length=True: it breaks a dataset with dimension dim into pieces of length N into a new dataset with dimensions dim and c
Its therefore somehow similar to stack/unstack but not really. The function nicely reflects what I get from the meaning of chunking from a dictionary and from Boer 2004 paper.
Maybe I rename it chunk_Boer? Still not happy about that.
from climpred.
I think for now you are fine to leave it just as "chunking" because we are aware that it's under esmtools.prediction
and not xr.chunking
. Maybe the doc string can be clear that these are different operations.
This is a low-priority issue, but I'm sure we can find some smart solution through stackexchange. I think it's fine as is, but I'm curious from a programming perspective how to tackle this. It might be good for you to post a question, because I'm not finding anything really.
from climpred.
as it is only an internal function _chunking
inside DPP, I think we can close this
from climpred.
Related Issues (20)
- HindcastEnsemble.verify() fails when valid_time of different object time than time HOT 3
- Refactor doctests for xarray 2022.06.01 HOT 1
- `HindcastEnsemble.remove_bias` with only one `lead` element drops `lead` dimension
- change `skill(init, lead)` to `skill(valid_time, lead)` to visualize forecasting barrier and reverse HOT 1
- make tqdm optional
- `HindcastEnsemble.resample()` working on `time` and `lead` HOT 1
- ⚠️ upstream-dev CI: `test_PerfectModelEnsemble_plot_bootstrapped_skill_over_leadyear` yerr negative HOT 2
- Using datatrees to represent datasets HOT 3
- Notebook downloading forecasts with herbie
- ValueError 'init' because it is not a variable or dimension in this dataset HOT 2
- Package dependency troubles with `python 3.11` HOT 7
- alignment=same_verifs throws CoordinateError HOT 1
- Reporting a vulnerability HOT 1
- Issue on page /quick-start.html HOT 1
- Implementing mean error as a verification metric? HOT 1
- `xclim.DetrendedQuantileMapping` with `train_test_split="unfair"` failing HOT 5
- Duplicate Classification entry
- New release of Climpred ? HOT 9
- Numerous documentation build warnings
- Codecov actions require tokens for v4 HOT 6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from climpred.