API wrapper for exllama, for high-performance usage of self-hosted large-language models
uogbuji / exllama-api Goto Github PK
View Code? Open in Web Editor NEWAPI wrapper for exllama, for high-performance usage of self-hosted large-language models
License: Apache License 2.0