wackygem / nicol Goto Github PK
View Code? Open in Web Editor NEWNicol is an open-source web service, developed using the Kotlin programming language, that enables streaming Server Stream Events and supports CPU inference for the port of llama2 model.
License: MIT License