Lista de corpus de PLN en español ✨ #Somos600M: Ayuda a desarrollar IA inclusiva que entienda las diferentes variedades de nuestras lenguas ✨ English-speaking contributors welcome!
Home Page: https://somosnlp.org/recursos/datasets
Hint: look for legal exams online and use them to create datasets
https://public.ukp.informatik.tu-darmstadt.de/thakur/BEIR/datasets/msmarco-v2.zip
Translate this BEIR dataset into spanish and upload to hugginface, following the same format as the original dataset.
You can use the translation script in ./general_scripts/googletrans_script.py to help you get started.
Original BEIR Repo: https://github.com/beir-cellar/beir
The BOLD dataset was generated by the Alexa AI team to evaluate bias in language models and it's based on Wikipedia. Since Wikipedia is translated into many different languages, generating an equivalent dataset in Spanish (or other related languages) is possible.
Link to the dataset in the Hugging Face hub: https://huggingface.co/datasets/AlexaAI/bold
https://public.ukp.informatik.tu-darmstadt.de/thakur/BEIR/datasets/scidocs.zip
Translate this BEIR dataset into spanish and upload to hugginface, following the same format as the original dataset.
You can use the translation script in ./general_scripts/googletrans_script.py to help you get started.
Original BEIR Repo: https://github.com/beir-cellar/beir
https://public.ukp.informatik.tu-darmstadt.de/thakur/BEIR/datasets/fiqa.zip
Translate this BEIR dataset into spanish and upload to hugginface, following the same format as the original dataset.
You can use the translation script in ./general_scripts/googletrans_script.py to help you get started.
Original BEIR Repo: https://github.com/beir-cellar/beir
https://huggingface.co/datasets/banking77
Translate banking77 dataset to spanish
You can use the translation script in ./general_scripts/googletrans_script.py to help you get started
It would be interesting to have questions about different Spanish-speaking countries. Hint: look for history exams online and use them to create datasets (ideally separated by country).
https://public.ukp.informatik.tu-darmstadt.de/thakur/BEIR/datasets/mmarco.zip
Translate this BEIR dataset into spanish and upload to hugginface, following the same format as the original dataset.
You can use the translation script in ./general_scripts/googletrans_script.py to help you get started.
Original BEIR Repo: https://github.com/beir-cellar/beir
Hint:
https://public.ukp.informatik.tu-darmstadt.de/thakur/BEIR/datasets/fever.zip
Translate this BEIR dataset into spanish and upload to hugginface, following the same format as the original dataset.
You can use the translation script in ./general_scripts/googletrans_script.py to help you get started.
Original BEIR Repo: https://github.com/beir-cellar/beir
Hint: Look for an English dataset and just translate the instruction since code is usually in English anyway
There are some corpus already that are worth including in the list:
https://public.ukp.informatik.tu-darmstadt.de/thakur/BEIR/datasets/dbpedia-entity.zip
Translate this BEIR dataset into spanish and upload to hugginface, following the same format as the original dataset.
You can use the translation script in ./general_scripts/googletrans_script.py to help you get started.
Original BEIR Repo: https://github.com/beir-cellar/beir
https://public.ukp.informatik.tu-darmstadt.de/thakur/BEIR/datasets/climate-fever.zip
Translate this BEIR dataset into spanish and upload to hugginface, following the same format as the original dataset.
You can use the translation script in ./general_scripts/googletrans_script.py to help you get started.
Original BEIR Repo: https://github.com/beir-cellar/beir
https://public.ukp.informatik.tu-darmstadt.de/thakur/BEIR/datasets/mrtydi.zip
Translate this BEIR dataset into spanish and upload to hugginface, following the same format as the original dataset.
You can use the translation script in ./general_scripts/googletrans_script.py to help you get started.
Original BEIR Repo: https://github.com/beir-cellar/beir
https://public.ukp.informatik.tu-darmstadt.de/thakur/BEIR/datasets/arguana.zip
Translate this BEIR dataset into spanish and upload to hugginface, following the same format as the original dataset.
You can use the translation script in ./general_scripts/googletrans_script.py to help you get started.
Original BEIR Repo: https://github.com/beir-cellar/beir
https://public.ukp.informatik.tu-darmstadt.de/thakur/BEIR/datasets/cqadupstack.zip
Translate this BEIR dataset into spanish and upload to hugginface, following the same format as the original dataset.
You can use the translation script in ./general_scripts/googletrans_script.py to help you get started.
Original BEIR Repo: https://github.com/beir-cellar/beir
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.
