Comments (5)
As the Wikipedia pretraining data is quite large, we will not release the full data. However, we will give some instructions about how to construct the training data recently. And, we have released the Wikidata embedding here.
from ernie.
@zzy14 Thanks for releasing your model and code! I have a follow up question regarding the wikipedia pretraining data: what is the entity linking tool you used to obtain aligned data? From the example code, it seems that the TAGME API is slow. Thanks!
from ernie.
@ledw In Wikipedia corpus, there are human-annotated alignments from the anchors.
from ernie.
@zzy14 Thanks for your reply. That makes a lot of sense. Any chance that you could also release the code for preprocessing the wikipedia corpus?
from ernie.
I am wondering when we can get instructions about how to construct the training data using Wikipedia?
from ernie.
Related Issues (20)
- 请问alias_entity.txt是如何生成的 HOT 1
- TAGME的authorization token要如何获得 HOT 3
- when using the model provided here(ernie_base) with multiple gpus, something wrong. HOT 3
- number of epoch HOT 1
- 关于TAGME实体抽取 HOT 2
- tried run_tacred.py, but training progress stuck at 0% for three days HOT 1
- 关于预训练的一个问题 HOT 1
- Inconsistent number of entity types of the OpenEntity dataset? HOT 1
- No such file or directory: 'kg_embed/entity2id.txt' HOT 2
- FileNotFoundError: [Errno 2] No such file or directory: .......ERNIE-master\\<input>' HOT 1
- 关于实体匹配 HOT 1
- 请教问题 HOT 3
- bermodel应用 HOT 3
- anchor2id.txt您访问的页面不存在 HOT 2
- Prepare Pre-train Data HOT 2
- 我想用自己的KG训练ERNIE,但不知道如何组织数据集 HOT 2
- How to finetune bert base version on FIGER dataset?
- 请问最后生成的pretrain_data/merge.bin和merge.idx大小为多少?
- 执行python3 pretrain_data/create_ids.py 4之后,生成的raw文件夹里的文件为空。 HOT 3
- ModuleNotFoundError: No module named 'fused_layer_norm_cuda'
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ernie.