Code Monkey home page Code Monkey logo

lstm_langid's Introduction

LSTM-LID

Source code for the paper A reproduction of Apple’s bi-directional LSTM models for language identification in short strings.

Installation

pip install LanguageIdentifier

Example

from LanguageIdentifier import predict
from LanguageIdentifier import rank

print(predict("Det her er dansk"))
print(rank("This is english")) 

predict outputs the most likely language of the sentence. rank returns a list of tuples containing their respective probabilities.

Paper and bibtex

The ACL Anthology is the official location for the paper: A reproduction of Apple’s bi-directional LSTM models for language identification in short strings.

If you use the library of paper in your work, please cite:

@inproceedings{toftrup-etal-2021-reproduction,
    title = "A reproduction of Apple{'}s bi-directional {LSTM} models for language identification in short strings",
    author = "Toftrup, Mads  and
      Asger S{\o}rensen, S{\o}ren  and
      Ciosici, Manuel R.  and
      Assent, Ira",
    booktitle = "Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop",
    month = apr,
    year = "2021",
    address = "Online",
    publisher = "Association for Computational Linguistics",
    url = "https://www.aclweb.org/anthology/2021.eacl-srw.6",
    pages = "36--42",
}

lstm_langid's People

Contributors

manuelciosici avatar

Stargazers

atejeda avatar Geograph avatar Shelly Sharma  avatar Gurumurthi V Ramanan avatar Bhavesh Kumar avatar Mohammadreza Yazdanifar avatar Younes Abouelnagah avatar Nelson Guamán avatar  avatar Dashstrom avatar Seyed Sajad Mirzababaei avatar frankfanslc avatar Loreto Parisi avatar Diwank Singh Tomer avatar ddelange avatar Jay Vala avatar  avatar  avatar Liyyy avatar Pengfei Xing avatar 爱可可-爱生活 avatar  avatar William Tambellini avatar György Orosz avatar Peter M. Stahl avatar Ciaran O'Reilly avatar Nickolay V. Shmyrev avatar Yansen Yang avatar RajeshShanmugam avatar Liyu Gong avatar

Watchers

 avatar William Tambellini avatar James Cloos avatar Nickolay V. Shmyrev avatar Cigdem Aslay avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.