openlmlab / moss_vortex Goto Github PK View Code? Open in Web Editor NEW 37.0 37.0 9.0 266 KB Moss Vortex is a lightweight and high-performance deployment and inference backend engineered specifically for MOSS 003, providing a wealth of features aimed at enhancing performance and functionality, built upon the foundations of MOSEC and Torch. License: GNU Affero General Public License v3.0 Shell 3.74% Python 96.26% chatgpt deployment inference natural-language-processing Introduction · People · Discuss
trust_remote_code=True错误以及model_dir大小写和use_onnx=True 原版程序docker运行报trust_remote_code=True错误, 将mosec_server.py第184行改为: tokenizer = AutoTokenizer.from_pretrained(MODEL_DIR, trust_remote_code=True) 并将174的小写改为大写MODEL_DIR,之后运行又爆出错误: onnxruntime.capi.onnxruntime_pybind11_state.InvalidProtobuf: [ONNXRuntimeError] : 7 : INVALID_PROTOBUF : Load model from moss-moon-003-sft-plugin-int4 failed:Protobuf parsing failed. 修改384行 use_onnx=False 又爆出trust_remote_code=True错误。
how can you get the url with PreprocessWorker I start a mosec server but cannot find the url for websocket
Vue.js 🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
javascript JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Machine learning Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Facebook We are working to build community through open source technology. NB: members must have two-factor auth.