Comments (7)
You can also take a look in the multinode AWS ECS guide. There you will see the two types of containers (which should correspond to two types of Kubernetes pods). The docker image is given a command to either be a configserver or services. Please note that you will have to know the hostnames of your config servers upfront and pass these in the environment variable described.
from vespa.
The host column in the documentation you mentioned is more like a mental model for where you would expect to see the processes. You can run everything on one host but in a larger production environment it makes sense to split up accordingly to reason about resource usage and handle lifecycle events.
For your questions, I would say 1) yes, 2) yes and 3) there is nothing technical why you should not run them on the same hosts.
As for Kubernetes we have limited experience with it - feedback on this would be very interesting.
from vespa.
On start/stop: There are only two different start/stop commands as you can see. The services should be started on all nodes in your cluster and configuration server on a fewer set of nodes (e.g 3) but configuration server can also run on the same node(s) as the services.
start services will start the Config sentinel process which needs the configuration server address to know which services it should start on a given node which again is configured in the application package which describes which high level services should where http://docs.vespa.ai/documentation/cloudconfig/application-packages.html.
We try to demonstrate this in the quick start http://docs.vespa.ai/documentation/vespa-quick-start.html but maybe the AWS multi-node guide is more informative on this http://docs.vespa.ai/documentation/vespa-quick-start-multinode-aws.html
from vespa.
@F21 Any updates on this?
from vespa.
@jobergum I haven't had a chance to try this out yet, but I hope to give it a spin before the end of the month.
from vespa.
Hi @aressem the link you've given http://docs.vespa.ai/documentation/vespa-quick-start-multinode-aws-ecs.html returns 404
I'm in need of a solution to run multinode vespa on Kubernetes.
from vespa.
@humayun0156 This is a 5-year-old issue. Living documentation move around. You can search for Kubernetes in current vespa doc here:
https://docs.vespa.ai/search.html?q=kubernetes
Good starting point is https://docs.vespa.ai/en/vespa-quick-start-kubernetes.html
from vespa.
Related Issues (20)
- Vespa Deploy fails for application package with model files HOT 3
- Add matched-elements-only support for index fields
- Syntax support for configuring distance-metric within the field
- No 'input' query param when use "vespa query yql=xxx" HOT 4
- Support setting metrics-proxy heap size HOT 3
- All Search Nodes are crashing HOT 4
- Potential Memory Leak Issue in PrometheusModel class HOT 4
- Node coming up with latest deployed application version after being down HOT 5
- Configurable max token length
- Add embedding instruction prompt support for to hf-embedder HOT 1
- NPE while deploying HOT 1
- Cluster Crashes When Distribution Key Is Too High HOT 2
- Error code - ORT_INVALID_PROTOBUF HOT 2
- Vespa content pod created snapshot folder owned by nobody user in a high RAM situation HOT 3
- Add deploy time warning about combining paged attributes with index (hnsw) or fast-search
- you probably have an older CPU than required HOT 7
- Unable to install Vespa version 8.334.22, dependencies not found HOT 2
- Tokenizer.json compability with ai.djl.huggingface tokenizers broken for sentencepiece based models HOT 4
- Add response degradation indicator for approximate nearest neighbor
- Support userQuery/userInput in the JSON query format
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from vespa.