Code Monkey home page Code Monkey logo

ted-rdf-mapping's Introduction

TED-RDF Mapping Suites

Tests TED-SWS documentation GitHub release (latest by date) GitHub last commit

GitHub contributors GitHub issues GitHub closed issues GitHub Repo stars GitHub forks GitHub

Contents

  1. Description
  2. Installation
  3. Contributing
  4. Licence

Description

Transformation rules and other artefacts for the TED RDF Conversion Pipeline (aka. TED Semantic Web Services or TED-SWS).

The artefacts provided in this repository are used or generated by the TED-SWS system in the form provided here. They are organised in packages called Mapping Suites.

Project documentation available here.

The following table indicates the implementation status of TED Standard Forms, split by Notice Type and Directive.

Notice Type Is implemented Directive 24 Directive23 Directive 25
pin-buyer F8 F8 F8
pin-only F1 na F4
pin-rtl F1 na F4
pin-cfc-standard F1 na F4
pin-cfc-social F21 F23 F22
qu-sy na na F7 & F22 (social)
cn-standard F2 F24 F5
cn-social F21 F22
subco na na na
cn-desg F12 F12
veat F15 F15 F15
can-standard Yes F3 F25 F6
can-social Yes F21 F23 F22
can-desg Yes F13 na F13
can-modif F20 F20 F20
corr F14 F14 F14
pin-tran na na na
can-tran na na na

Installation

To assist the semantic engineers in the development of mapping suites a toolchain has been developed. The toolchain is documented on the documentation page. In order to install it open a terminal and follow the instructions below.

  1. Clone the project from GitHub
git clone https://github.com/OP-TED/ted-rdf-mapping
cd ted-rdf-mapping
  1. Create and activate a virtual environment
python -m venv venv
source venv/bin/activate
  1. Use makefile target to install the requirements
make install

Contributing

You are more than welcome to help expand and mature this project.

When contributing to this repository, please first discuss the change you wish to make via issue, email, or any other method with the owners of this repository before making a change.

Please note we adhere to Apache code of conduct, please follow it in all your interactions with the project.

Milestones

Each milestone corresponds to a foreseen release of the ontology.

Issue labels

The issues are classified based on for classification dimensions:

  • type label
    • bug - something implemented incorrectly in a release
    • missing feature - something expected but missing from a release
    • feature request - something requested to be implemented in a future release
    • implementation question - something needs clarified, refined or decided before the implementation can continue
    • release question - something needs clarified before a release is considered accepted
  • action label
    • for implementation - it can be implemented and closed, all is clear
    • for closing - it can be closed but an additional confirmation is needed
  • auxiliary label
    • ppds - it is related to the PPDS project
    • bdti - it is related to the BDTI project

Licence

The documents, such as reports and specifications are licenced under a CC BY 4.0 licence.

The source code and other scripts are licenced under EUPL v1.2 licence.

ted-rdf-mapping's People

Contributors

ahmadjana avatar captainofhacks avatar costezki avatar csnyulas avatar dragos0000 avatar duprijil avatar fokoug avatar gefok1 avatar idellal avatar kaleanych avatar rousso avatar valexande avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Forkers

schivmeister

ted-rdf-mapping's Issues

x1.1.delta: Conceptual Mappings: Section I.2.1 Can not assume that there is no joint procurement

In the forms indicating joint procurement is not compulsory so if it is not in the xml it does not exclude that joint procurement does not exist. Therefore for example in 163-2021 we cannot assume joint procurement does not occur. Joint procurement cannot be calculated by having many buyers in the procedure see recital 71 of the Directive 2014/24/EU:

Joint procurement can take many different forms, ranging from coordinated procurement through the preparation of common technical specifications for works, supplies or services that will be procured by a number of contracting authorities, each conducting a separate procurement procedure, to situations where the contracting authorities concerned jointly conduct one procurement procedure either by acting together or by entrusting one contracting authority with the management of the procurement procedure on behalf of all contracting authorities.

The field in xml is not a compulsory field so we may draw no conclusions except that joint procurement occurs if it is indicated

I would suggest the mapping from the xml is: if true then in rdf it is also true but if not mentioned in the xml then it should not be mentioned in the rdf

x1.1.delta: Rdf Relation: Contract bindsBuyer Buyer

If joint procurement is concerned then all Buyers may or may not be jointly responsible for a given procedure and may or may not be bound by a contract. However in a notice we do not know to which extent a Buyer is involved in a joint procurement. Therefore we cannnot assume "Contract bindsBuyer" is correct the only thing we can assume is that the Procedure involves all the Buyers.

An example of Contract bindsBuyer can be seen in notice 2705-2021.

Therefore it seems this relation is inappropriate in the rdf

x1.1.delta:Where can authority table mappings be found?

In the package/transformation/resources the json files of the authority tables can be found but they are the full authority tables from EU Vocabularies, however the forms do not necessarily use all the concepts found in EU Vocabularies.

For example if we take :

  • buyer-legal-type for F03 we only use 6 concepts of the 22 concepts in EU Vocabularies.
  • main-activity for F03 we only use 10 concepts out of 21 concepts in EU Vocabularies ( and in other forms the concepts that will be used will be different.

x1.1.delta: Conceptual Mappings - Section V.2.13: Boolean instead of controlled list used.

•V.2.13 The mapping in the rdf does not map to the code list as indicated in the mapping excel:
?this epo:playedByBusiness / epo:hasBusinessSize http://publications.europa.eu/resource/authority/economic-operator-size](http://publications.europa.eu/resource/authority/economic-operator-size)

In the rdf there is a boolean.

See example 2705-2021 where it indicates that the Winner is not a business which would be false in this case.

x1.1.delta: Conceptual Mappings - Section V.2.4

The total value of the contract is mapped to (example 163-2021)

epo:Tender / epo:MonetaryValue / xsd:decimal ?this epo:hasFinnancialOfferValue / epo:hasAmountValue ?value .

The lowest offer and the highest offer taken into consideration are mapped to ( example 2750-2021)

epo:SubmissionStatisticalInformation / MonetaryValue / xsd:decimal ?this epo:hasLowestReceivedTenderValue / epo:hasAmountValue ?value .

I have some concerns about the usage of Tender here, especially if negotiations are involved. In the case of the total value in the best case scenario one could argue that the tender value has changed but we have a temporal problem here. However taking the LowestReceivedTenderValue from the SubmissionStatisticalInformation does not seem correct.

Publication date of notice

The Publication data I take it will be in the metadata and not the content of the Notice. However the ontology sees it in the Notice class. Since the PPDS needs the Publication Date maybe we should add it in the mapping?

tx1.1delta In 131568: Lots 4 and 5 are not awarded however there is a LotAwardOutcome indicating winner selected and association with a tender with a financial offer

tx1.1.delta: Conceptual Mappings: Section 1.4 Buyer Legal Type missing 19698-2021

missing buyer-legal- tupe19698-2021: The concept in the xml is "other" which is not in the authority table buyer-legal-type. Therefore there should also be a description which is not foreseen in the ontology

What is more the ontology states Organization hasLegalType and the mapping hasBuyerType so there are inconsitencies where the mappings exist.

Also the authority table is floating in some of the diagrams of the ontology

The buyer-legal-type mapping in resources does not foresee the xml element "other"

CPV and supplementary CPV

In sections II.1.2. and II.1.2.1 both the Main CPV code and the Supplemenatary CPV code should use the predicate hasMainClassification.

In Sections II.2.2.1 and II.2.2.2 both Main CPV code and the Supplementary CPV code should use the predicate hasAdditionalClassification

Also to be noted is the Supplemenary CPV is missing from the ontology probably due to the fact that it is not used in eForms

II.2.2.1 only one code shown see 348503-2021 also 337360-2021

tx1.1.delta: V1.1.1No tenders or requests to particpate were received or all were rejected mapping to be discussed

A mappin was done to:
all-rej: All tenders, requests to partipate or projects were withdrawn or found inadmissible.

However the xml does not cover withdrawl but does cover:
No tenders, requests to participate or projects were received.

How to map this elment needs to be discussed.

Also in such cases the tender is not instatiated when there could have been a tender, this is another reason for not instantiating the tender because it can not be coherently instantiated. However it is needed for instantiating the foreseesSubcontracting

See examples in 19698-2021

x1.1.delta: Conceptual Mappings: Buyer vs Additional Buyer

In the rdf (ie in 2705-2021) I notice in the URI there is 1 Buyer and several Additional Buyers, however the rdf:type is Buyer.
Neither in the excel nor in the ontology do I see the concept AdditionalBuyer.

Will the fact that the resource path is different for the different Buyers be ignored ie will this fact have any impact on the meaning of the concept?

It was previously stated
• When having one Buyer, we link main activity & legal type to the organisation of this Buyer
• If we have additional Buyers (many buyers), we need add an Organisation Group: The group hasMember all the organisations (Main & Aditional) and the MainActivity/BuyerLegalType are at the Group Level.

We have no indication in the notices who is the main and who is the additional Buyers.

Further more their is a relationship Contract bindsBuyer we cannot be sure from the notice that the Contract binds the buyer it only binds the buyer that signs the contract not those that may use the contract

x1.1.delta: Conceptual Mappings: Section II.2.3: Place of Performance

The mapping of the NUTS code is via a predicate hasSpecificPlaceOfPerformace however I think this is reserved for the "main place of performance"
The ontology also forsees hasBroadPlaceOfPerformance also via "ContractTerms" which is better suited to the NUTS however it points to another code list

x1.1.delta: Conceptual Mappings: Section I.2.2 Can not assume that the contract is not awarded by a CPB

The field in xml concerning the award of a contract by a cpb isnot a compulsory field so we may draw no conclusions except that it is awarded by a cpb when it is indicated as such in the xml.

I would suggest the mapping from the xml is: if true then in rdf it is also true but if not mentioned in the xml then it should not be mentioned in the rdf ie no false indicator as per 373713-2021

In case of true see: 214679-2021

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.