Comments (5)
Please use udpipe for tokenization.
from elmoformanylangs.
Hi! @Oneplus Thank you for quick reply. Can you take a look on this issue, # . Do I have to add "" and "" at the start and end of the sentences?
from elmoformanylangs.
Hi @sbmaruf you won't need the starting " and ending " for each sentence. We've already handle the bos and eos token in our code. It seems the unstable output is resulted from the stateful LSTM in ELMo. But empirically, it does not hurt the performance.
from elmoformanylangs.
@Oneplus Thank you for your reply. That helps a lot.
from elmoformanylangs.
Hi @sbmaruf you won't need the starting " and ending " for each sentence. We've already handle the bos and eos token in our code. It seems the unstable output is resulted from the stateful LSTM in ELMo. But empirically, it does not hurt the performance.
Hi @Oneplus. Is there maybe some way to disable the statefulness of LSTM in ELMo? It hurts performance in my case.
from elmoformanylangs.
Related Issues (20)
- Error when importing elmofromanylans in my code HOT 2
- HELP! An error occur run: 'from elmoformanylangs import Embedder' HOT 2
- Convert csv to conllu format HOT 1
- anyone ever had this problem?
- Fine-tuning existing models
- token的时候create_one_batch方法中获取bow和eow的id的时候为什么互换了两个id的位置
- A suggestion about simplified-Chinese ELMo
- Programmatic way to get dimension of embedding
- Logging is very noisy HOT 1
- Default to sample...json as needed HOT 1
- 请问简体中文的训练语料可以从哪里获得呢?
- Document Embedding
- 请问如何进行elmo2sents
- --train_path data/en.raw \ 训练数据的格式是什么样的
- Dependency Parsing usage
- Running the model on GPU HOT 1
- from elmoformanylangs import Embedder HOT 9
- Pre-trained model download link invalid HOT 2
- The size of output model is very large when exporting to ONNX format.
- directory error HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from elmoformanylangs.