Comments (5)
jacobbieker
commented on May 30, 2024
1
Yeah, that sounds good!
from nowcasting_dataloader.
JackKelly
commented on May 30, 2024
This implemented now, I think. Is that right, @jacobbieker?
from nowcasting_dataloader.
jacobbieker
commented on May 30, 2024
Yeah, we give it the ID, but we don't actually do anything with the ID. AS in, if a systems ID is 576, then the model gets 576 as the input, if that works?
from nowcasting_dataloader.
JackKelly
commented on May 30, 2024
Yeah... although it might be slightly better to first wrap the ID in an embedding (which should "magically" cluster similar GSPs in vector space... and should help the model understand that GSP ID 100 isn't necessarily "similar" to ID 101, even though they have adjacent numerical IDs)
from nowcasting_dataloader.
JackKelly
commented on May 30, 2024
yeah, it might help a bit... not sure though!
from nowcasting_dataloader.
Related Issues (20)
- Subselect doesn't work without the metadata in Batch HOT 4
- Update NWP fake data
- GSP Position Encodings are not sliced correctly
- GSP plotting time axis HOT 8
- Update branch pytest workflow
- Speed up Position Encodings HOT 4
- Rename dims to data_vars
- Move Position Encoding to BatchML
- `normalise()` should have consistent behaviour across DataSources: It should give mean=0 and std=1. HOT 3
- Automatically check that data is normalised roughly correctly for each batch
- Tidy batch code
- use `float32` for `nwp`, `sat_data`, and `hrv_sat_data`?
- Remove Fake BatchML
- Normalize pv and gsp coords HOT 2
- Load 2 batches at once HOT 2
- Standarise x and y osgb names
- Run CI every Monday HOT 2
- Changes required to support Power Perceiver
- `SatelliteML`: Change `x` and `y` to `x_geostationary` and `y_geostationary`, and include `x_osgb` and `y_osgb` HOT 2
- Failing test: `tests/test_position_encoding.py::test_batch_encoding` HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from nowcasting_dataloader.