soilwise-he / governance Goto Github PK

From ESDAC communication:

SoilWise considers the foreseen legal obligations and follows the development of the EU Soil Health Law and its implementation

From ESDAC communication:

Idea is to provide a Data Management Plan template, to be used by Soil Mission Projects, which is useful for EUSO

Reasoning: There is a need for engagement with important R&I projects in a way to understand what is being created, what is coming when it is available and usable, and who will use the data and stakeholder analysis. Identification of the projects’ Data Management Plans and workflows is foreseen. It would be useful if EUSO together SoilWISE could informally collaborate with some EU projects in order to shape a DMP that is useful for SOILWISE and EUSO

should be governed by rules.

JRC (and REA?) has a strong say in this as it is meant to be used/useful to JRC/EUSO.

Current guidance by JRC on high value datasets (to them):
Criteria: if they contain 1) Information (data and knowledge) with at least national scale, 2) is related to the Mission Soil objectives, and/or 3) is relevant for the Soil Monitoring Directive (SMD)

for knowledge: linked to objectives of SMD and CRC Framework (carbon), SW use cases, EU projects?

From ESDAC communication:

SoilWise must provide catalogue services, enabling the end users to discover available results from R&I projects.

Below approach suggests a mechanism to populate the catalogue for european academic resources.

• Esdac maintains a list of relevant funded projects at https://esdac.jrc.ec.europa.eu/projects/Eufunded/Eufunded.html
• This list should be a starting point as a filter on deliverables on Cordis
• Cordis itself queries Openaire based on a RCN (project identifier) to retrieve additional resources (mainly for older projects.
• The project deliverables itself live in repositories such as Zenodo, Dataverse, Springer, etc.

Above is the formal route to register resources, it may however lead to disappointment on lacking resources (which are available but not registrered through the formal route). Other routes can also be efectuated, but the user may have to disable a 'formal' filter

Codelists are best endorsed/mandated by an authority or vivid community

How will Soilwise interact with authorities/communities to have soil codelists adopted?

Current and upcoming codelist initiatives, which may need confirmation by a EU authority

• Glosis codelists
• IUSS WRB codelists
• INSPIRE codelists
• Land management practices
• Biology codelists
• EEA GEMET
• Agrovoc

New codelists on soil health indicators

A governance model for maintenance of codelists should be available for any endorsed codelist

Codelist repositories should be persistent and standardised (SKOS)

Are current codelists compatible with definitions in legislation?

From ESDAC communication:

SoilWise repository should harvest from R&I projects, especially those with funding from the Mission ‘A Soil Deal for Europe’, thus ensuring the legacy of the Mission

From ESDAC communication:

EUSO is a project that is more than a data infrastructure; it is also a community, a policy evaluation and communication tool, a monitoring framework that includes LUCAS Soil, etc.

What

Source 10.1111/ejss.13507

Monitoring soil health in a comprehensive manner, understanding the interplay between soils and the essential functions they deliver are pivotal to design solutions and policy intervention to ensure sustainable management of soils. In the European Union (EU), a pivotal role in this respect is played by a dedicated platform, the EU Soil Observatory (EUSO).

EUSO is developed by the Joint Research Centre (JRC) of the EC and published in a dedicated platform that is publicly accessible

EUSO contributes directly to the advancement of scientific knowledge on soils in the EU through its in-house research activities. In 2023, the scientists working in the EUSO published 46 papers in Scopus-indexed journals and numerous technical reports. Moreover, the EUSO hosted and mentored six PhD candidates in 2020–2023 in the context of the Collaborative Doctoral Partnership (CDP)

EUSO is responsible for the soil monitoring elements of the Horizon Europe Mission ‘A Soil Deal for Europe’ (Soil Mission, 2021). The Soil Mission is providing funding of nearly 1 billion Euro over the period 2022–2030 to soil-relevant HORIZON Europe projects and 100 Living Labs

The EUSO Stakeholder Forum, organised annually by the EUSO, is an open and inclusive event providing an
opportunity to engage with the European and global soil community. The Stakeholder Forum brings together
soil scientists, policymakers, regional and national bodies and interested citizens

The Stakeholder Forum is organised around Working Groups (WGs), which are a key element of the EUSO involving stakeholders. The WGs are composed of relevant topical experts from academia, businesses or policy and are co-chaired by EUSO staff and external partners. Each WG develops its own work agenda, aiming to provide relevant advances to current
scientific and policy questions. In 2023, six WGs were active:

1. data sharing and integration,
2. soil erosion,
3. soil biodiversity,
4. SOC monitoring reporting and verification,
5. soil monitoring and
6. soil pollution.

Main objective

To provide the EC and the broader soil user community with the knowledge and data needed to monitor,
safeguard and restore soils at EU level. EUSO supports the EU policies by ensuring that the EC is able to fully capitalise on the information made available through integrated data flows by transitioning from simply monitoring to understanding

Sub objectives

1. Support the development of an operational EU-wide Soil Monitoring System.
2. Further consolidate and enhance the capacity and functionality of the ESDAC.
3. Monitor the state of soil health and the policies in place to enhance soil protection, through Soil Health and Policy Dashboards.
4. Support research and innovation through the implementation of Horizon Europe's Mission ‘A Soil Deal for Europe’
5. Provide an open and inclusive European Soil Stakeholders Forum that supports citizen engagements and the drive towards a societal change in the perception of soil.

Activities:

• implementing an EU-wide soil monitoring system, supporting soil research and innovation
• enhancing the capacity and functionality of the European Soil Data Centre (ESDAC)
• monitoring soil health and policies in the EU
• supporting citizen engagements regarding soil matters

History

The ambitious objectives of the Soil Mission and the legislative proposal for a Soil Monitoring Law requested scientific evidence about the state of soil health in the EU. To support the Green Deal, the EUSO was launched by the EC in December 2019.

From ESDAC communication:

SoilWise notes that no high-frequency data is expected. However, high volume of data (rasters of the order of GB) is expected.
It can be also be that versions or updates of existing datasets is foreseen

Impact4soil has recently been introduced, it is a deliverable of the orcasa project. Plans exist within the consortium to let SWR benefit from technology or content of the impact4soil platform. For that reason it needs to be clarified if any constraints (authorization, attribution, embargo) apply to those contributions of the impact4soil platform.

A meeting between the technical teams of both platforms will be scheduled in october 2024, would be good if this issue is clarified before that date.

Users would login and:

• deploy containers with updated software
• create new users (and assign privileges)
• define (endpoint, filters, schedule) and monitor harvester runs
• users login and upload (meta)data
• users define a transformation workflow on an dataset uploaded by them
• users define a transformation workflow on an dataset they intend to download from the platform
• users provide feedback on existing resources or discussions

As indicated in soilwise-he/harvesters#5, ESDAC website currently hosts a number of relevant resources to EUSO/SWR. Such as knowledge items, datasets, vacancies, events. Some interaction is required to understand the current and post project governance of these resources. For which resources ESDAC will act as a source, for which EUSO/SWR. Which resources should be shared between the platforms, which not.

SWR should focus on synchronising those resource which will be shared, and ESDAC remains as source.
Also those items which are currently maintained in ESDAC but are expected to migrate to EUSO/SWR require special attention.

An alternative option is that ESDAC and EUSO will over time both use the same SWR technology.

see also soilwise-he/harvesters#5 and soilwise-he/harvesters#6

From ESDAC communication:

EUSO aims for a single access point of soil related data at EU level to ensure persistence in results.

From ESDAC communication

The Repository will link with national data portals but will not store raw national data.

at various states of the lifecycle choices need to be made, which require governance be in place

lifecycle changes

• Only via pull requests (review)

Record creation

• are there any quality criteria a record should have (persistent identification, usage constraints (license), contact point)
• are there any topic constraints to be applied (soil data yes, meteorological data no)

Record archival

In principle metadata is not removed from the index if it is removed remotely, because it may break the knowledge graph, instead we tag the resource as archived (and it may be excluded from search results)

Record removal

In some cases records really need to be removed from the index, for example if they cause conflicts, or other inconsistencies.

copernicus is a research and monitoring programme of EEA, ESA, EMS and JRC. They maintain a data catalogue with research and monitoring results.

Suggestion would be set up a harvester to that catalogue filtered by 'xxx'

Initial research indicates that the catalogue is an instance of Plone CMS (non harvestable), but is imported from a number of remote sources (which are CSW harvestable):

• a geonetwork instance at https://land.copernicus.vgt.vito.be/geonetwork
• a geonetwork instance at https://sdi.eea.europa.eu/catalogue

Copernicus also hosts a STAC catalog to their resources, available at https://catalogue.dataspace.copernicus.eu/stac, a dedicated STAC harvester could be relevant

If and how can we discuss with copernicus to best harvest their assets, which assets are relevant to the soil community.

In 4 situations governance on GDPR may be relevant:

• Statistics on usage of Soilwise resources by anonymous users, as monitored via usage monitoring
• Input retrieved from logged in users
• Resources stored in the Soilwise repository which have a usage restriction based on existing GDPR claims of the provider (location information)
• Individuals which are mentioned by name/address as author/publisher of a resource, typically are not considered sensitive in scope of GDPR

From ESDAC communication:

Data should be stored in a (guaranteed) accessible permanent data storage

• Exchange/interoperable format .
• Accompanied by metadata -template from JRC/SoilWise.

From ESDAC communication

From the communication with ESDAC:

Listed resources in the SWR are categorised as

• data
• knowledge from Soil Mission projects
• other resources relevant to soil health R&I projects

There are still leads (and contributors) needed for

• GIT
• PostgreSQL

At https://data.jrc.ec.europa.eu/ JRC hosts a central data catalogue, how does esdac relate to this catalogue

• are there relevant sources to be harvested by EUSO
• does it make sense to advertise esdac resources via the JRC catalogue (advantage is that they are broadcasted via common channels)