Code Monkey home page Code Monkey logo

Comments (5)

hiyouga avatar hiyouga commented on September 10, 2024

template 是什么

from llama-factory.

msqp avatar msqp commented on September 10, 2024

qwen2_vl

from llama-factory.

msqp avatar msqp commented on September 10, 2024

ASCEND_RT_VISIBLE_DEVICES=7 API_PORT=7702 python src/api.py --model_name_or_path Qwen/Qwen2-VL-7B-Instruct --template qwen2_vl

from llama-factory.

hiyouga avatar hiyouga commented on September 10, 2024

没复现出来,更新一下代码。

{
    "model": "string",
    "messages": [
        {
            "role": "user",
            "content": [
                {
                    "type": "text",
                    "text": "描述图片内容?"
                },
                {
                    "type": "image_url",
                    "image_url": {
                        "url": "https://dashscope.oss-cn-beijing.aliyuncs.com/images/dog_and_girl.jpeg"
                    }
                }
            ]
        }
    ]
}
{
  "id": "chatcmpl-c025438b2ae041df82707d0d2c12e126",
  "object": "chat.completion",
  "created": 1725722811,
  "model": "string",
  "choices": [
    {
      "index": 0,
      "message": {
        "role": "assistant",
        "content": "图片中是一个小女孩和她的狗在海滩上玩耍。小女孩穿着格子衬衫,坐在沙滩上,手里拿着一个玩具,正和她的狗互动。狗是一只黄褐色的拉布拉多,戴着一个彩色的项圈,似乎在用前爪与小女孩握手。背景是广阔的海洋,天空中有一些云彩,阳光从右侧照射过来,整个场景显得非常温馨和愉快。",
        "tool_calls": null
      },
      "finish_reason": "stop"
    }
  ],
  "usage": {
    "prompt_tokens": 241,
    "completion_tokens": 85,
    "total_tokens": 326
  }
}

from llama-factory.

hiyouga avatar hiyouga commented on September 10, 2024

可能是模型精度问题,目前 NPU 的 fp16 推理会差一点,请参考 pr:huggingface/transformers#33312

from llama-factory.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.