Code Monkey home page Code Monkey logo

eerie_hackathon_2023's Introduction

Repository of the first EERIE hackathon

This repo contain infromation necessary for data access, and examples of data processing for 1st EERIE hackathon

Agenda

https://events.hifis.net/event/913/timetable/?view=standard

Data

The EERIE simulations are in progress, so initially examples will be based on data from other projects, but there are already some EERIE based examples as well. We will gradually update examples with EERIE simulations when they become available.

We have compiled a list of variables that we aim to make available during the hackathon. https://docs.google.com/spreadsheets/d/1HWtNO28EBd4O6PdOh5RCHIHsgQ_TByT5F4i2ugNVTfg/edit#gid=0

There are two sheets:

  • EERIE: comprises first-priority variables interpolated to a 0.25-degree regular grid. We will try to deliver these for all simulations.

  • WP7: lists second-priority variables. We will also strive to deliver these, but availability might differ among modeling groups.

Kindly plan your hackathon tasks with this in mind.

Data structure

Data will be available through intake catalogs. It might be new experience for many, so please have a loot at:

Simulations

Current overview of simulations:

Screenshot 2023-11-08 at 22 06 07

More detailed information about the availability of data on different grids and time frequencies can be found in the readme of each individual model's subfolder.

IFS/FESOM

Test data
EERIE simulations
  • eerie-control-1950 - tco1279-NG5 (atmosphere 10 km, ocean 5-13 km). Currently 2 years available.
    • cat['dkrz']['disk']['model-output']['ifs-fesom2-sr']['eerie-control-1950']

ICON

Test data (not used in hackathon)
EERIE simulations
  • eerie-control-1950 - 5 km ocean and 10km atmosphere
    • cat['dkrz']['disk']['model-output']['icon-esm-er']['eerie-control-1950']
    • Please note that for the first 7 years (model years 2002-2008), the 3d daily atmosphere (not 2d) are instantaneous values. This has been rectified to daily mean values from model year 2009 onwards.

UM/NEMO

Initial data from the full eerie-piControl simulation is available:

Model Suite ID Data
HadGEM3-GC5-EERIE-N96-ORCA1 cy163 1851 - 2081
HadGEM3-GC5-EERIE-N216-ORCA025 cy021 1851 - 1981
HadGEM3-GC5-EERIE-N640-ORCA12 cx993 1851 - 1901

CMORised atmosphere data is available on JASMIN in the /gws/nopw/j04/eerie/public/data/EERIE/ directory. The folder structure follows the CMIP conventions. The ocean data has not been CMORised but the raw ocean and seaice netCDF files have been included in the same directory structure (regridded and one variable per file).

IFS

Data from AMIP (atmosphere-only forced with sea surface temperature (SST) and sea ice concentration (SIC)) runs is available. Given the purpose of the AMIP runs to study the impact of the presence of mesoscale features, the runs exist in pairs: One is forced with observed SST and SIC, taken from the OSTIA dataset (also available under #OBSERVATIONS), while in a twin experiment the observed SST anomalies are smoothed out with a filter the length scale of which is a multiple of the local Rossby radius of deformation. The multiple is indicated in the run ID, i.e. lr30 implies a factor of 30. For more details see #OBSERVATIONS.

Run Data SST
amip-hist-obs 2010 - 2020 unfiltered OSTIA SST
amip-hist-obs-lr30 2010 - 2020 OSTIA SST smoothed with 30 x Rossby radius
amip-ng-obs 2020 - 2021 unfiltered OSTIA SST
amip-ng-obs-lr30 2020 - 2021 OSTIA SST smoothed with 30 x Rossby radius

The "hist" runs are historical runs with time-dependent forcing based on IFS CY48R1.1, including some new EERIE source updates. The "ng" runs use the NextGEMS cycle 3 configuration, i.e. perpetual 2020 forcing (except for SST & SIC).

OBSERVATIONS

Here is README with description of observations

What you need to get started

How to start

The easier way to move forward is to login to the system you going to work with (DKRZ or JASMIN) and clone this repo:

git clone https://github.com/eerie-project/EERIE_hackathon_2023.git

Then go to jupyterhub of DKRZ or JASMIN and execute notebooks from there.

To login to JASMIN to clone the repository, you can either use SSH or you can use the JASMIN jupyterhub and go to Launcher (blue cross) and then choose a new Terminal.

  • account: bk1377 (make sure you are a member of it)
  • profile: at least 50GB memory
  • 20gb home. more data can be temporarily saved in /scratch/b/BNUMBER . if your account starts with m use m/MNUMBER
  • server runs for specific amount of time, you can close the browser, the server continues. Unless you stop it via the hub control panel.

jasmin notebook service https://notebooks.jasmin.ac.uk

stops when there is no activity

General knowlege

Individual models

Each coupled model example is located in individual folders, which are in turn split into components. Begin with START_HERE.ipynb for each component, and then explore the notebooks from the list in the README.

Examples

Standard variables

Here is the list of variables, that will be available during hackathon.

External resources

Contribution

We welcome contributions to the EERIE_hackathon_2023 project! Depending on the extent of your contributions, you can follow one of the two processes:

Small Contributions

For small, one-time contributions, please follow the standard GitHub process:

  1. Fork the repository.
  2. Create a new branch in your fork.
  3. Make your changes and commit them to your branch.
  4. Create a Pull Request (PR) from your branch to the main repository.

Large Contributions

If you plan to make many contributions, you may request write access to the repository. Even with write access, it's best practice to:

  1. Create a new branch for your changes.
  2. Commit your changes to that branch.
  3. Create a Pull Request (PR) from your branch to the main branch.

This ensures that changes are reviewed and integrated systematically. Please avoid committing directly to the main branch.

Thank you for your interest in contributing to the EERIE_hackathon_2023 project!

Model documentation and useful links

IFS/FESOM

ICON

IFS/NEMO

UM/NEMO

IFS

eerie_hackathon_2023's People

Contributors

datmojo avatar dputrasahan avatar florianziemen avatar fraserwg avatar jonseddon avatar koldunovn avatar mandresm avatar mattphysics avatar mwklai avatar mwklaimwklai avatar robertsmalcolm avatar wachsylon avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.