Comments (5)
kristiankielhofner
commented on June 22, 2024
1
It's in the wisng branch with force_language=en or whatever the ISO code of your language is.
The Tovera hosted best effort community WIS instances aren't running wisng yet but if you're hosting your own we'd appreciate any testing!
from willow-inference-server.
kristiankielhofner
commented on June 22, 2024
1
Good point, we'll create some CPU benchmarks. I also updated the README to mention support CPU in the first bullet line.
from willow-inference-server.
SamJongenelen
commented on June 22, 2024
I unfortunately don't have a video card in my server that is strong enough to run WIS - so I'll wait :)
from willow-inference-server.
kristiankielhofner
commented on June 22, 2024
WIS runs CPU only.
In any case, the Tovera hosted WIS instances should be upgraded sometime next week (pending testing results). I'll also probably spin up wisng on a different URL. I'll report back here for you when I do.
As I said, we'd appreciate the testing!
from willow-inference-server.
SamJongenelen
commented on June 22, 2024
Wow then i misread i guess, because of the benchmarks in the readme? I'm running on a ~2015 NUC and HA on odroid n2 , will try once i have some time again
from willow-inference-server.
Related Issues (20)
- flake8: logger.debug broken over multiple lines HOT 1
- Run "bare metal"? HOT 1
- Running in SystemD for boot startup HOT 3
- Error during install.sh HOT 3
- wis server unresponsive. HOT 12
- Unable to start server (CUDNN_STATUS_NOT_INITIALIZED) HOT 6
- LLM installation issue HOT 3
- Merge default settings with custom settings
- WIS Server CPU Mode - Model returns "you." only HOT 7
- WIS on WSL with GPU - Windows Firewall handling HOT 1
- Upon system reboot after using nohup ./utils.sh run, the nginx docker container does not come back, and the WIS container is stuck in restarting state HOT 4
- [Feature] Support Chatbot to use other LLM models such as ChatGLM-6B HOT 19
- Allow to specify the location of TLS certificate and host name to use. HOT 5
- Error when running download_models.sh HOT 9
- Ubuntu Dependency Script is throwing repository errors, no longer runs successfully HOT 3
- Error running build.sh (Ubuntu 22.04) (Unable to locate package zstd) HOT 6
- WIS installation failed with ./deps/ubuntu.sh HOT 3
- WIS returned HTTP error: 500 HOT 3
- WIS restart HOT 6
- current versions of grpcio/protobuf crash chatbot/utils.sh install 13B HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from willow-inference-server.