Comments (3)
Could you please be specific about what you mean by teacher model. It's not clear enough for me.
from alicemind.
Thank you for your reply. The teacher model is the teacher's pre training model, as shown in the following code:
teacher = TeacherBertForSequenceClassification.from_pretrained(
training_args.teacher_path,
from_tf=bool(".ckpt" in training_args.teacher_path),
config=config,
alignrep=training_args.alignrep,
)
from alicemind.
Hi,you can train the teacher model conveniently using the scripts provided by huggingface.
from alicemind.
Related Issues (20)
- RuntimeError: gather(): Expected dtype int64 for index
- There might be sth wrong in this file mPLUG/videocap_mplug.py
- Fine-tuning video captions HOT 1
- Inference of image captioning on single image HOT 4
- how to get the pre-trained model "ViT-L-14.tar"
- how to get ued model A Unified Pretraining Framework For Passage Ranking And Expansion
- “mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video”代码是否会开源?
- Grounding checkpoint evaluation results
- “VECO 2.0: Cross-lingual Language Model Pre-training with Multi-granularity Contrastive Learning”代码是否会开源?
- Missing partial code and files of gqa for VQA in mPLUG
- Zero-Shot Video Captioning script issues HOT 1
- Could you upload StructuralLM to HuggingFace ?
- The logprob of image captioning result of mplug is very small
- SDCUP
- SDCUP训练问题
- 表格数据集
- mplug中两处代码错误问题
- can i pretrain mPLUG model with my own dataset
- Cannot download https://alice-open.oss-cn-zhangjiakou.aliyuncs.com/StructBERT/en_model
- The past_key_value in MPLUG doesn't seem to work.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from alicemind.