Comments (4)
From my understanding I think it would require some efforts to adapt it to your dataset. I guess though this depends on what kind of Dialogue System you want to build (e.g. e2e vs just the policy). For example, for an agenda policy (user) check multiwoz and you'll notice it's very customised to this very dataset. From the system perspective, if you want to use an RL algorithm (either those in the library or implement one of your own) I think it's much easier, given it's good quality code and design (well, this is in general, it is a good library). Perhaps @zqwerty can correct me if I'm wrong. Cheers!
from convlab-2.
From my understanding I think it would require some efforts to adapt it to your dataset. I guess though this depends on what kind of Dialogue System you want to build (e.g. e2e vs just the policy). For example, for an agenda policy (user) check multiwoz and you'll notice it's very customised to this very dataset. From the system perspective, if you want to use an RL algorithm (either those in the library or implement one of your own) I think it's much easier, given it's good quality code and design (well, this is in general, it is a good library). Perhaps @zqwerty can correct me if I'm wrong. Cheers!
That's right. To build a dialogue system in a new dataset, you can train the model with some modification for data processing.
from convlab-2.
From my understanding I think it would require some efforts to adapt it to your dataset. I guess though this depends on what kind of Dialogue System you want to build (e.g. e2e vs just the policy). For example, for an agenda policy (user) check multiwoz and you'll notice it's very customised to this very dataset. From the system perspective, if you want to use an RL algorithm (either those in the library or implement one of your own) I think it's much easier, given it's good quality code and design (well, this is in general, it is a good library). Perhaps @zqwerty can correct me if I'm wrong. Cheers!
Thanks for your advices. My dataset is in Chinese language. So if I want to build a Dialogue Syste in pipeline form, do I need modify all the part(nlu,dst,policy,nlg)? And if I just want to use an RL algorithm in the library and apply it to my private data, so what I should do is to modify the code in policy part(add some code about data processing)?
I am new to this domain. Thanks again for your patience.
from convlab-2.
So if I want to build a Dialogue Syste in pipeline form, do I need modify all the part(nlu,dst,policy,nlg)?
Yes
And if I just want to use an RL algorithm in the library and apply it to my private data, so what I should do is to modify the code in policy part(add some code about data processing)?
You also need a user simulator for your RL policy training.
from convlab-2.
Related Issues (20)
- [BUG] `try` does NOT work HOT 1
- Training Data HOT 1
- RULEDST evaluation HOT 9
- [Maintenance] pip takes too long in finding boto3 versions (100+ tries & still failed to install) HOT 7
- [BUG] Failed to build agent on CoLab HOT 2
- Spacy latest version compatibility HOT 2
- Different end-to-end results of DAMD HOT 1
- spacy tokenizer HOT 1
- Integrating with my own dataset HOT 3
- [BUG] 关于中文数据集crosswoz上policy-rule代码的问题 HOT 1
- BERTNLU postprocess.py 为什么可以通过 if intent_logits[j] > 0: 来获得intent的预测呢? HOT 2
- [Maintenance] docker for m1 mac, please HOT 1
- Issue in BertNLU HOT 4
- Unable to get the pretrained BERTNLU model. HOT 7
- Unable to get the pretrained BERTNLU model even after updating the URLs HOT 7
- installation python 3.7 on CentOS7 failed[BUG] HOT 2
- The Link to the datasets of LAUG is unreachable HOT 3
- [BUG] Failed to build tokenizers HOT 3
- 是否可以使用不经过训练后的BERTNLU呢 HOT 7
- Why the end-2-end performance mismatch with component level evaluation? HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from convlab-2.