European OpenLLM Projects

One LLM to free them all ;-)

Did you know that English tokens represent more than 90 % of generalist LLMs training data ?

We’re OpenLLM Europe 🇪🇺, an Open Source community committed to empower LLM projects in all European languages, specifically medium and low-resource languages. We aim to build the first multimodal multilingual european model with partners all over the continent.

OpenLLM-Europe 🇪🇺
Discord: https://discord.com/invite/b5UQTWQn
Contact:[email protected] - https://github.com/OpenLLM-Europe

Our work is 100% open and fits in with ALT-EDIC's mission, which you can discover here: https://language-data-space.ec.europa.eu/related-initiatives/alt-edic_en

ALT = for Alliance for Language Technologies EDIC
EDIC = European Digital Infrastructure Consortium

The mission of the ALT-EDIC is to develop a common European infrastructure in Language Technologies, focussing particularly on Large Language Models. It seeks to improve European competitiveness, increase the availability of European language data and uphold Europe's linguistic diversity and cultural richness. The ALT-EDIC is a multi-country project, run and funded by the Member States who have agreed to join it. By pooling resources, the members should achieve the critical mass of data and other resources needed to create and finetune Large Language Models, which any single member would find difficult to do alone.

OpenLLM Europe 🇪🇺 is thus making its contribution to identifying and attempting to federate national initiatives to create LLMs or learning datasets. Our goal is to federate, create together & promote open source and sovereign Generative AI digital commons.

Here is a list of Open Source projects in AI (mostly LLMs) that we have gathered during our research.

Feel free to use it to build great things together. Feel free to amen it and add projects that we missed. PR are welcome ! Feel free to join our Discord server

Multilingual European Open Source project 🌍

HPLT - Contact:[email protected]
Unbabel - Contact:https://communityonboarding.unbabel.com/signup/step/0
Occiglot - Contact:brack.cs.tu-darmstadt.de
TrustLLM - Contact:[email protected]
Luxembourg Institute of Science and technology - Luxembourg 🇱🇺 - Contact:[email protected]
Sosnitskij - https://www.linkedin.com/in/said-azizov-6b5a82256/
Evidently AI - Multilingual 🌍 - Discord: https://discord.gg/evidentlyai - Contact:[email protected]
YugoGPT - 🇷🇸🇭🇷🇧🇦🇲🇰🇽🇰 - Discord: https://discord.gg/yugogpt - https://www.linkedin.com/in/aleksagordic/

Open Source LLM projects based outside of Europe

LangFuse US project using european languages 🇺🇸 - Contact:[email protected]
Sayhan - Turkish 🇹🇷 - https://www.linkedin.com/in/sayhan-yalva%C3%A7er-0617641b1/
Sestek - Turkish 🇹🇷 - Contact:[email protected]
AI Forever - Armenian 🇦🇲 - https://www.linkedin.com/in/said-azizov-6b5a82256/
Yandex YaLM 100B - Russian and English 🇷🇺🇬🇧 - Contact:[email protected]
EleutherAI - International collaboration using english 🌍 - Discord:https://discord.com/invite/zBGx3azzUn - Contact:[email protected]

openllm-europe / european-openllm-projects Goto Github PK