Code Monkey home page Code Monkey logo

ud_latvian-lvtb's Introduction

Summary

Latvian UD Treebank is based on Latvian Treebank (LVTB), being created at University of Latvia, Institute of Mathematics and Computer Science, Artificial Intelligence Laboratory.

Introduction

Latvian UD Treebank v2.6 consists of 13,643 sentences (219,955 tokens), and it has been obtained by automatic conversion of both the morphological and the syntactic annotations of the original LVTB treebank. LVTB data contains manually verified syntactic annotation according to a hybrid dependency-constituency schema, as well as manually verified morphological tags and lemmas. LVTB is released in parallel with Latvian UD Treebank since v2.2 and features the same version numbers. The corresponding LVTB versions are listed here. Key LvtbNodeId in Latvian UD Treebank CoNLL-U field MISC provides the mapping from Latvian UD Treebank to LVTB. Each LVTB version is superset of the corresponding Latvian UD Treebank version in terms of included sentences.

Acknowledgments

This work is supported by European Regional Development Fund under the grant agreement No. 1.1.1.1/16/A/219 (Full Stack of Language Resources for Natural Language Understanding and Generation in Latvian) in synergy with the grant agreement No. 1.1.1.2/VIAA/1/16/188. The pilot project was supported by State Research Programme "National Identity".

References

Pretkalniņa L., Rituma L., Saulīte B. Deriving enhanced Universal Dependencies from a hybrid dependency-constituency treebank. Proceedings of the 21sh International Conference Text, Speech, and Dialogue, LNCS, Vol. 11107, Springer Link, 2018, pp. 95-105

Grūzītis N., Pretkalniņa L., Saulīte B., Rituma L., Nešpore-Bērzkalne G., Znotiņš A., Paikens P. Creation of a Balanced State-of-the-Art Multilayer Corpus for NLU. Proceedings of the 11th International Conference on Language Resources and Evaluation (LREC). Miyazaki, Japan, 2018, pp. 4506-4513

Pretkalniņa L., Rituma L., Saulīte B. Universal Dependency Treebank for Latvian: A Pilot. Human Language Technologies - The Baltic Perspective, Frontiers in Artificial Intelligence and Applications, Vol. 289, IOS Press, 2016, pp. 136-143

Pretkalniņa L., Rituma L. Constructions in Latvian Treebank: The Impact of Annotation Decisions on the Dependency Parsing Performance. Human Language Technologies - The Baltic Perspective, Frontiers in Artificial Intelligence and Applications, Vol. 268, IOS Press, 2014, pp. 219-226

Pretkalniņa L., Nešpore G., Levāne-Petrova K., and Saulīte B. Towards a Latvian Treebank. Actas del III Congreso Internacional de Lingüística de Corpus. Valencia, Spain, 2011, pp. 119-127

Pretkalniņa L., Nešpore G., Levāne-Petrova K., and Saulīte B. A Prague Markup Language profile for the SemTi-Kamols grammar model. Proceedings of the 18th Nordic Conference of Computational Linguistics. Riga, Latvia, 2011, pp. 303-306

Licensing

This data set is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

By using this data set, you agree to comply with the European Intellectual Property Rights and the European General Data Protection Regulation.

Please, let us know if you use this data set for product or service development.

Data splits

The training data covers various text types: news, fiction, academic texts, legal texts, transcripts of spoken language, etc. The development and test sets are carefully split out to cover all those types.

Train: 10156 sentences
Dev: 1664 sentences
Test: 1823 sentences

Changelog

2020-05-15 v2.6

  • Some singular errors fixed.

2019-11-15 v2.5

  • Added more data, improved consistency.
  • Major revision in what Latvian model considers secondary predicative components ('obl', 'appos', 'xcomp' etc. in UD terms).
  • The reflexive pronoun 'sevis' is not a reciprox.
  • Some objects are actually 'obl'.
  • Adjective definetness fixed.
  • Multiple singular errors fixed.

2019-05-15 v2.4

  • Added more data.
  • Participle voice fixed.
  • Issues #5, #6, #7, #8 fixed in the original data.
  • Fixed annotation errors according to the more strict validator.

2018-11-15 v2.3

  • Added more data.
  • Negative verbs and participles now have lemmas without the prefix 'ne'.
  • Both masculine and feminine adjectives have the same lemma (masculine).
  • Fixed varios annotation errors.

2018-04-15 v2.2

  • Repository renamed from UD_Latvian to UD_Latvian-LVTB.
  • Fixed tokenization for text errors.
  • Added notifications in the MISC field for corrected text errors.
  • Improved enhanced dependencies.
  • Added more data.

2017-11-15 v2.1

  • Removed duplicated and artificially constructed sentences.
  • Fixed a bug producing Evident=Fh,Nfh where Evident=Fh should be.
  • Added significantly more data.
  • Added enhanced dependencies.

2017-02-15 v2.0

  • Annotation changed according to UD v2 guidelines.
  • Lots of new data.
  • Some annotation errors corrected.

2016-11-15 v1.4

  • Corrected a number of syntactic annotation mistakes.
  • Multi-word conjunctions: first part is now tagged PART.
  • Added new sentences.
=== Machine-readable metadata =================================================
Data available since: UD v1.3
License: CC BY-SA 4.0
Includes text: yes
Genre: news fiction legal spoken academic
Lemmas: manual native
UPOS: converted from manual
XPOS: manual native
Features: converted from manual
Relations: converted from manual
Contributors: Pretkalniņa, Lauma; Rituma, Laura; Saulīte, Baiba; Nešpore-Bērzkalne, Gunta; Grūzītis, Normunds
Contributing: elsewhere
Contact: [email protected], [email protected]
===============================================================================

ud_latvian-lvtb's People

Contributors

dan-zeman avatar lauma avatar normundsg avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.