Comments (5)
template 是什么
from llama-factory.
qwen2_vl
from llama-factory.
ASCEND_RT_VISIBLE_DEVICES=7 API_PORT=7702 python src/api.py --model_name_or_path Qwen/Qwen2-VL-7B-Instruct --template qwen2_vl
from llama-factory.
没复现出来,更新一下代码。
{
"model": "string",
"messages": [
{
"role": "user",
"content": [
{
"type": "text",
"text": "描述图片内容?"
},
{
"type": "image_url",
"image_url": {
"url": "https://dashscope.oss-cn-beijing.aliyuncs.com/images/dog_and_girl.jpeg"
}
}
]
}
]
}
{
"id": "chatcmpl-c025438b2ae041df82707d0d2c12e126",
"object": "chat.completion",
"created": 1725722811,
"model": "string",
"choices": [
{
"index": 0,
"message": {
"role": "assistant",
"content": "图片中是一个小女孩和她的狗在海滩上玩耍。小女孩穿着格子衬衫,坐在沙滩上,手里拿着一个玩具,正和她的狗互动。狗是一只黄褐色的拉布拉多,戴着一个彩色的项圈,似乎在用前爪与小女孩握手。背景是广阔的海洋,天空中有一些云彩,阳光从右侧照射过来,整个场景显得非常温馨和愉快。",
"tool_calls": null
},
"finish_reason": "stop"
}
],
"usage": {
"prompt_tokens": 241,
"completion_tokens": 85,
"total_tokens": 326
}
}
from llama-factory.
可能是模型精度问题,目前 NPU 的 fp16 推理会差一点,请参考 pr:huggingface/transformers#33312
from llama-factory.
Related Issues (20)
- 执行验证的时候报错的问题
- 【bug】internlm2_5 models is not supported, it seems a mismatch of model name prefix and default_template
- 4卡4090 训练 qwen1.5 14b时候 4个显卡都在加载模型 导致显存溢出。 HOT 2
- ValueError: Some keys are not used by the HfArgumentParser: ['ddp_timeout', 'do_eval', 'output_dir', 'overwrite_output_dir', 'per_device_eval_batch_size', 'predict_with_generate'] HOT 3
- reward model 导出报没有config 错误
- 最新版LLaMA Factory,使用vllm推理报错 HOT 1
- 您好 通义千问如何做继续预训练? HOT 1
- Documentation (Linux): Installation requires nvidia-container-toolkit
- qwen2_vl ChildFailedError HOT 1
- lora训练llama3-70B正常,但是训练完后eval和predict时会报warning: "Invalidate trace cache @ step 16430: expected module 2, but got module 0" HOT 5
- 调用src/train.py,传递的参数好像被配置文件覆盖,怎么修改都不改变模型训练运行时的参数 HOT 3
- 使用LLamafactory加载模型和使用huggingface加载模型,效果不同 HOT 1
- transformer版本升级原因 HOT 1
- 运行Qwen-VL的sft训练时卡住,请问这是什么原因呢? HOT 5
- llama factory save strategy HOT 4
- qwen2-7b 使用vllm api接口报错 HOT 1
- Why is LoRA much slower than Freeze? HOT 1
- LLaMA-Factory运行webui后页面一片空白
- Qwen2-vl sft训练问题,报错 AttributeError: 'DeepSpeedZeroOptimizer_Stage3' object has no attribute 'train' HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from llama-factory.