Comments (6)
Hi @AbnerCode ,
Thanks a lot for being interested in this work and checking out the code!
Question 1
No, we use the second encoder to encode retrieved knowledge. As the baseline model doesn't incorporate external knowledge, there is only one encoder – title encoder.
Question 2
For KOBE, condition_context_attn
is not used in transformer.py
, but used in tensor2tensor.py
. Make sure you have the latest code. See:
KOBE/core/models/tensor2tensor.py
Line 298 in 6f06ec5
from kobe.
Hi @qibinc ,
It is such an honor to hear from you.
So, as you say, you only use the title encoder as your baseline, which does not use the BiAttention. Is it like this?
from kobe.
Hi @AbnerCode ,
The above figure displays the architecture of KOBE.
For baseline, which is without the knowledge encoder, looks like this:
Best,
Qibin Chen
from kobe.
Hi @qibinc ,
Thanks for your reply!
In addition, I wanna know why you use the 2 layer transformer as the decoder. Generally, the layer is set as 6.
Best wishes!
from kobe.
Hi @AbnerCode ,
In addition, I wanna know why you use the 2 layer transformer as the decoder. Generally, the layer is set as 6.
Please check out #13. It mentions the same problem.
from kobe.
Hi @qibinc ,
Thanks!
Best Wishes
from kobe.
Related Issues (20)
- Issue with evaluating model with beam search HOT 4
- Named entity to match product title with knowledge graph HOT 2
- Explaination about your preprocessed data HOT 3
- Failed to download the processed training data HOT 1
- detail user category HOT 1
- At the end of the run, the bleu score can no longer be improved at around 6. HOT 5
- Is there any dataset in English? HOT 1
- how long does the training process last?Could u please provide the training result? HOT 3
- How do you build the fact file in raw data? HOT 8
- Good name! HOT 1
- inference HOT 2
- 请问怎么在自己的数据集上做finetune和推理? HOT 4
- Error when preprocessing dataset HOT 1
- Why did you delete bi-attention code? HOT 2
- English language dataset HOT 1
- 关于模型的generate的API试用问题 HOT 1
- ignore this issue
- 关于24-V2训练
- WandB Link?
- 请问有图生文的部分吗
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kobe.