Comments (6)
XeeKee
commented on August 16, 2024
I think it's reasonable too. Serac replaces large models with smaller ones, so its logical reasoning ability will be somewhat weaker.
from easyedit.
zxlzr
commented on August 16, 2024
Hi, do you have any further questions?
from easyedit.
SXxinxiaosong
commented on August 16, 2024
但是large models的output使用的是编辑前的知识，按理说是不能输出正确答案的。
from easyedit.
XeeKee
commented on August 16, 2024
During prediction, we used the teacher forcing mechanism. For example, when predicting the third token of the label, the model can see the first two correct labels, which may result in the accuracy before editing not being zero.
from easyedit.
zxlzr
commented on August 16, 2024
Hi, do you have any further questions?
from easyedit.
SXxinxiaosong
commented on August 16, 2024
No thanks!
…---- 回复的原邮件 ----
| 发件人 | ***@***.***> |
| 发送日期 | 2024年06月17日 21:19 |
| 收件人 | zjunlp/EasyEdit ***@***.***> |
| 抄送人 | xxs ***@***.***>,
Author ***@***.***> |
| 主题 | Re: [zjunlp/EasyEdit] SERAC的portability在edit之后降低了？ (Issue #300) |
Hi, do you have any further questions?
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you authored the thread.Message ID: ***@***.***>
from easyedit.
Related Issues (20)
- Evaluation Question HOT 4
- locality and portability evaluation HOT 8
- GRACE sequential edit result HOT 15
- IKE fluency HOT 2
- ccks gpt2-xl 模型 为什么用roberta模型加载？ HOT 2
- R-ROME has poor performance when using GPT2-xl HOT 2
- WISE CONTEXT_TEMPLATES_CACHE HOT 7
- WISE tokenize HOT 7
- what is the meaning of archive HOT 2
- [Wise] Editing loss = nan + 0 HOT 2
- AttributeError: Can't pickle local object 'length_collation.<locals>.collate_fn' HOT 8
- Issue with KN batch editing HOT 2
- Question about ZSRE experiment, how to reproduce results in your WISE paper? HOT 6
- PermissionError: [Errno 13] Permission denied: './results/models/MEND/gpt2-xl' HOT 3
- Using MEND with monkeypatch from higher HOT 10
- CCKS2024 ROME Question HOT 6
- WISE errors HOT 3
- Use EasyEdit with KnowEdit HOT 13
- Error calculation "adj_k" to edit LLAMA-3-8B using MEMIT HOT 4
- 关于wise.py HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from easyedit.