This repository demonstrates how to build an AI-powered chatbot with visual Search using the LlamaIndex, Azure OpenAI and weaviate Vector Database.

• Chatbot on top of Azure OpenAI Model

• LlamaIndex to index and query the data

• Weaviate Vector Database to store data vectors

• 📸 Visual search for a product: you can upload an image for product and the chatbot will provide with similar products we have in the store using OpenAI Vision

• 👕 Chat with retails store you can ask also chat with the chatbot to help you find what you are looking for

2. Deploy the following models
3. Embeddings
4. GPT-4
5. GPT-4 - GPT-4 Turbo with Vision Preview

How to install Weaviate | Weaviate - Vector Database

git clone https://github.com/mmz-001/knowledge_gpt
cd knowledge_gpt

To install the required Python packages, run the following command:

pip install -r requirements.txt

Create a secrets.toml file in the .sreamlit folder with the following contents:

##Weaviate  
weaviate_url="<weaviate_url>"  
weaviate_api_key="<weaviate_api_key>"  
class_name="Products"  
  
##Azure OpenAI  
openai_key = "<openai_key>"  
azure_endpoint = "https://<resource_name>.openai.azure.com/"  
api_version ="2024-02-15-preview"   #or the most recent one 
  
## Chat Model  
chat_model_deployment_name="<text>"  
chat_model_name="gpt-4-1106-preview"  #or the most recent one 
  
#embedding model  
embedding_model_deployment_name="<embedding_deployment_name>"  
embedding_model="text-embedding-ada-002"  
  
  
## Vision Model  
vision_model_deployment_name="vision" 

streamlit run main.py 

As soon as you run the script as shown above, a local Streamlit server will spin up and your app will open in a new tab in your default web browser.