infinity4b / lmdeploy Goto Github PK
View Code? Open in Web Editor NEWThis project forked from internlm/lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
Home Page: https://lmdeploy.readthedocs.io/en/latest/
License: Apache License 2.0