Comments (8)
In your example, we don't know this instance contains the relation "per:country_of_birth" in advance. Here we just initialize the virtual type words according to the pre-defined relation classes rather than estimate the prediction with the prior distributions. So there is no “the chicken or the egg?” problem here. You can refer to the "issue 遇到问题求助 #1" for specific examples of the prior distributions over the candidate set.
from knowprompt.
Thanks for your reply !
In your paper, you obtain the scope of the potential entity types with prior knowledge contained in a specific relation, so if we don't know the relation that the instance contains , how can we get the scope of the potential entity types and then estimate the prior distributions over the candidate set? I'm confused about this...
from knowprompt.
The calculation is according to pre-defined categories, for example, there are only two categories: "per:birth_of_place", and "per:birth_of_data". Thus, for [sub], p("person"): 1; for [obj],p("place"): 0.5, p("data"): 0.5. You can read code for a deeper understanding.
from knowprompt.
Thanks for your reply!
That's how I understood it before, so it means that the representation of virtual type words in each instance would be the same at the start? This is different from what is claimed in your paper that you can obtain the scope of the potential entity types with prior knowledge contained in a specific relation.
from knowprompt.
the representation of virtual type words are statistics initialized at the start, and what the model learns during training is the latent virtual type.
from knowprompt.
It means that the representation of virtual type words in each instance would be the same at the start, right?
from knowprompt.
Yes.
from knowprompt.
Thanks for your patience !
from knowprompt.
Related Issues (20)
- 遇到问题求助 HOT 1
- 关于预训练语言模型选择的问题 HOT 2
- paper中虚拟的type word是每个relation都一样吗? HOT 2
- experiment result HOT 1
- ValueError: too many values to unpack (expected 4) HOT 1
- Missing weighted average function for virtual answer word HOT 4
- 效果复现 HOT 2
- 运行报错 HOT 13
- Hi! How to run this code with BART model? Would you give an example of parameters setting? Thank you so much!! HOT 4
- 有关virtual type words的embedding的初始化问题 HOT 10
- 关于two-stage中的第一个阶段,论文中的描述是否和代码不一致 HOT 1
- some questions about the code HOT 1
- pytorch_lightning.utilities.exceptions.MisconfigurationException: No `test_dataloader()` method defined to run `Trainer.test`. HOT 1
- About the calculation of \phi(r) HOT 1
- 关于 KE loss 即论文中 "Implicit Structured Constraints" 的一些疑问 HOT 2
- 直接使用label信息,是否相当于泄露给模型信息 (已回答) HOT 9
- a bug?
- 求问作者实验需求显存大小 HOT 2
- How to initialize the learnable relation embedding? HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from knowprompt.