re previous comment: ollama is running but i believe you may have issues back referencing the host using host.docker.internal on linux. I've subsequently tried this on windows which has the exact same error as the original issue around $HOME. Also on windows if i follow the guide you referenced docker compose up doesn't work as the api fails its health check. Disabling the health check seems to generate further issues.

from genai-stack.

Which model you are using? could you provide your .env file?

from genai-stack.

below is .env

#*****************************************************************

LLM and Embedding Model

#*****************************************************************
LLM=llama2 #or any Ollama model tag, gpt-4, gpt-3.5, or claudev2
EMBEDDING_MODEL=sentence_transformer #or google-genai-embedding-001 openai, ollama, or aws

#*****************************************************************

Neo4j

#*****************************************************************
NEO4J_URI=neo4j://database:7687
NEO4J_USERNAME=neo4j
NEO4J_PASSWORD=password

#*****************************************************************

Langchain

#*****************************************************************

Optional for enabling Langchain Smith API

#LANGCHAIN_TRACING_V2=true # false
#LANGCHAIN_ENDPOINT="https://api.smith.langchain.com"
#LANGCHAIN_PROJECT=#your-project-name
#LANGCHAIN_API_KEY=#your-api-key ls_...

#*****************************************************************

Ollama

#*****************************************************************
OLLAMA_BASE_URL=http://host.docker.internal:11434

#*****************************************************************

OpenAI

#*****************************************************************

Only required when using OpenAI LLM or embedding model

#OPENAI_API_KEY=sk-...

#*****************************************************************

AWS

#*****************************************************************

Only required when using AWS Bedrock LLM or embedding model

#AWS_ACCESS_KEY_ID=
#AWS_SECRET_ACCESS_KEY=
#AWS_DEFAULT_REGION=us-east-1

#*****************************************************************

GOOGLE

#*****************************************************************

Only required when using GoogleGenai LLM or embedding model

GOOGLE_API_KEY=

from genai-stack.

It seems weird, llama2 should work. What's your run time environment and docker-compose.yml then?

***edited
Have you install ollama in your host machine? OLLAMA_BASE_URL=http://host.docker.internal:11434/ <= here is calling the ollama in your host machine in container

p.s. I have encounter the same problem while using gemma2:2b. I fix it following this guide. You might also install the ollama in your host machine and connect it from container.

from genai-stack.

oki, did two things, confirmed that ollama_base_url is set to http://llm:11434 same error as before.

When running ollama locally and following the guide you sited, i get an error when chatting to the bot on: http://localhost:8501/

ConnectionError: HTTPConnectionPool(host='localhost', port=11434): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x73f8ba4db190>: Failed to establish a new connection: [Errno 111] Connection refused'))

This is with ollama_base_url set to: http://host.docker.internal:11434

from genai-stack.

ConnectionError

The ConnectionError is showing that it can't connect to your local ollama. Is your local ollama running? Please check it in your terminal by

curl 127.0.0.1:11434

You should get a "ollama is running" message.

If it is not running, start it by

ollama serve

from genai-stack.

tracked it down to a computer issue, this is working

from genai-stack.