Comments (6)
Those scores are without pretraining.
Results with pretraining on asr can be found here
from qd-detr.
Thank you for the quick response! :) I had a look at the w/ PT scores in PapersWithCode, and it seems they are referenced from the Highlight Detection results table and moreover, they seem to be scores obtained by other models. For example, the QD-DETR only Video w/ PT score seems to be linked to the SL-Module method by Xu et al. (2021) - column PR. Similarly, the QD-DETR w/ PT score is linked to the sLSTM method by Zhang et al. (2016) - column BK. Is there a mistake, or am I reading this the wrong way?
from qd-detr.
Sorry, but I do not understand your question.
Besides, in the paper, there are no results with ASR-pretrained models for our method.
from qd-detr.
Sorry for not being clear with my question. What I meant to ask is - if you go here, and hover over the score values for "w/ PT", it seems to refer to scores which are completely unrelated to the QD-DETR model. So I was wondering what you meant when you said that the results with ASR pre-training can be found in the link you provided?
from qd-detr.
Oh, sorry for confusing you.
In the paper, we didn't actually report the results after ASR-pretraining.
But for someone who might be interested in the results after ASR-pretraining, we pretrained QD-DETR with ASR captions first following the instructions on README and then trained QVhighlights dataset to obtain the numbers in the link.
Details for ASR-pretraining can be found in Moment-DETR and if you follow the instructions in README to pretrain first and then train on QVHighlights, you sure may be able to reproduce the numbers in the link.
from qd-detr.
Ah, I see! Sorry, I guess I just got confused with the interface of the PapersWithCode website. Thank you for the quick clarification! :) Closing this issue now as it's been resolved.
from qd-detr.
Related Issues (20)
- The implement of rank-aware contrastive loss HOT 2
- What does parameter "use_tef" mean? HOT 2
- At training, RuntimeError: The size of tensor a (148) must match the size of tensor b (150) at non-signleton dimesnion 1
- Confusion about the code HOT 1
- TypeError: unsupported operand type(s) for /: 'dict' and 'float' HOT 4
- The I3D features about Charades-STA HOT 3
- Training Machine Question HOT 1
- Charades dataset feature
- Training on Charades-STA dataset with VGG backbone HOT 10
- Fail to download TVsum dataset and could you please provide a new link? HOT 2
- TVSUM Result HOT 2
- TVSUM data issue HOT 4
- SharePoint: That didn't work - user cannot be found in the directory HOT 1
- About run_on_videos HOT 6
- Use videoonly.ckpt HOT 5
- The hyper parameters of using SF+CLIP features on Charades-STA HOT 9
- official feature files for QVHighlights dataset HOT 3
- About ablation study HOT 1
- Pretraining Modules with Contrastive Learning? HOT 1
- With the same seed, the set of eval_epoch can really influence the performance of model! Why? HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from qd-detr.