Comments (3)
anirbanbasu
commented on August 12, 2024
I used llama3 with my Ollama installation. In my case, Ollama is installed separately on macOS and started with ollama serve before executing docker compose up as the instructions suggest. (Of course, I had llama3 pulled already on my Ollama installation.)
Are you running on Linux? I haven't tested on that.
from genai-stack.
Kannan665
commented on August 12, 2024
Yes.....I am running on Linux.....I am using Ubuntu 18.04 LTS......I tried using the same docker compose codes and only replaced Llama3 in place of Llama2......It pulled all the necessary containers.......But could see lot of bugs in chat BOT, as well as pdf BOT......
from genai-stack.
Kannan665
commented on August 12, 2024
Yes.....I am running on Linux.....I am using Ubuntu 18.04 LTS......I tried using the same docker compose codes and only replaced Llama3 in place of Llama2......It pulled all the necessary containers.......But could see lot of bugs in chat BOT, as well as pdf BOT......
Have successfully run Llama3:8B.....When I initiate the first chat-BOT through /localhost/8501/, the UI for prompting continues to hide behind the RAG enable/disable box.....But when you copy and paste a text file, by pointing slightly into the "prompt-box", it accepts the entry and gives the response......All other BOTs are working normally.......I tried Llama:70B, but it took way beyond the normal pulling time and exited......
from genai-stack.
Related Issues (20)
- build issue, stopped building at bot[5/8]
- dependency failed to start: container genai-stack-api-1 is unhealthy HOT 8
- App 1 - Support Agent Bot not working HOT 5
- Steamlit Text Box Covered by "Select RAG mode" HOT 4
- I'm unable to use the pdf_bot using AWS claudev2
- Error: pull model manifest: ssh: no key found - Cannot pull model from within containerized Ollama instance HOT 1
- Error: Head "http://host.docker.internal:11434/": dial tcp 192.168.178.36:11434: i/o timeout -> pull-model-1 exited with code 1 HOT 1
- Version Update needed: ValueError: alternative_import must be a fully qualified module path
- pull-model Warning
- service "pull-model" didn't complete successfully: exit 1
- ERROR [genai-stack-api internal] load metadata for docker.io/langchain/langchain:latest
- Docker stuck at creating container HOT 1
- ERROR invalid setting OLLAMA_MODELS="" error="$HOME is not defined" HOT 1
- Build failure on genai-stack-api-1 container HOT 2
- pull-model-1 | ERROR invalid setting OLLAMA_MODELS="" error="$HOME is not defined" HOT 1
- Some issue about qa RAG chain design HOT 1
- LangChainDeprecationWarning: The class `HuggingFaceEmbeddings` was deprecated in LangChain 0.2.2
- load_embedding_model関数をOpenAIの埋め込みモデルを使用するように変更する
- error running docker compose on linux HOT 7
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from genai-stack.