Your organization requires a Multi-Channel Smart Chatbot and a search engine capable of comprehending diverse types of data scattered across various locations. Additionally, the conversational chatbot should be able to provide answers to inquiries, along with the source and an explanation of how and where the answer was obtained. In other words, you want private and secured ChatGPT for your organization that can interpret, comprehend, and answer questions about your business data.

The goal of the MVP POC is to show/prove the value of a GPT Virtual Assistant built with Azure Services, with your own data in your own environment. The deliverables are:

1. Backend Bot API built with Bot Framework and exposed to multiple channels (Web Chat, MS Teams, SMS, Email, Slack, etc)
2. Frontend web application with a Search and a Bot UI.

The repo is made to teach you step-by-step on how to build a OpenAI based Smart Search Engine. Each Notebook builds on top of each other and ends in building the two applications.

For Microsoft FTEs: This is a customer funded VBD, below the assets for the delivery.

Prerequisites Client 3-5 Days POC

• Azure subscription
• Accepted Application to Azure Open AI, including GPT-4 (mandatory)
• Microsoft members need to be added as Guests in clients Azure AD
• A Resource Group (RG) needs to be set for this Workshop POC, in the customer Azure tenant
• The customer team and the Microsoft team must have Contributor permissions to this resource group so they can set everything up 2 weeks prior to the workshop
• A storage account must be set in place in the RG. Disable firewalls and enable public network access from all networks
• Data/Documents must be uploaded to the blob storage account, at least two weeks prior to the workshop date
• For IDE collaboration during workshop, Jupyper Lab will be used, for this, Azure Machine Learning Workspace must be deployed in the RG
  • Note: Please ensure you have enough core compute quota in your Azure Machine Learning workspace

1. The user asks a question.
2. In the app, an OpenAI LLM uses a clever prompt to determine which source contains the answer to the question.
3. Four types of sources are available:
   • 3a. Azure SQL Database - contains COVID-related statistics in the US.
   • 3b. Azure Bing Search API - provides online web search for current information.
   • 3c. Azure Cognitive Search - contains AI-enriched documents from Blob Storage (10k PDFs and 52k articles).
     • 3c.1. Uses an LLM (OpenAI) to vectorize the top K document chunks from 3c.
     • 3c.2. Uses in-memory cosine similarity to get the top N chunks.
     • 3c.3. Uses an OpenAI GPT model to craft the response from the Cog Search Engine (3c) by combining the question and the top N chunks.
   • 3d. CSV Tabular File - contains COVID-related statistics in the US.
4. The app retrieves the result from the source and crafts the answer.
5. The tuple (Question and Answer) is saved to CosmosDB to keep a record of the interaction.
6. The answer is delivered to the user.

https://gptsmartsearch.azurewebsites.net/

To open the Bot in MS Teams, click HERE

• Uses Bot Framework and Bot Service to Host the Bot API Backend and to expose it to multiple channels including MS Teams.
• 100% Python.
• Uses Azure Cognitive Services to index and enrich unstructured documents: Detect Language, OCR images, Key-phrases extraction, entity recognition (persons, emails, addresses, organizations, urls).
• Uses LangChain as a wrapper for interacting with Azure OpenAI , vector stores, constructing prompts and creating agents.
• Multi-Lingual (ingests, indexes and understand any language)
• Multi-Index -> multiple search indexes
• Tabular Data Q&A with CSV files and SQL Databases
• Uses Bing Search API to power internet searches in the bot
• Uses CosmosDB as persistent memory to save user's conversations.
• Uses Streamlit to build the Frontend web application in python.

Note: (Pre-requisite) You need to have an Azure OpenAI service already created

1. Fork this repo to your Github account.
2. In Azure OpenAI studio, deploy these two models: Make sure that the deployment name is the same as the model name.
   • "gpt-35-turbo" for the model "gpt-35-turbo (0301)". If you have "gpt-4", use it (it is definitely better)
   • "text-embedding-ada-002"
3. Create a Resource Group where all the assets of this accelerator are going to be. Azure OpenAI can be in different RG or a different Subscription.
4. ClICK BELOW to create all the Azure Infrastructure needed to run the Notebooks (Azure Cognitive Search, Cognitive Services, SQL Database, CosmosDB, Bing Search API):

Note: If you have never created a cognitive multi-service account before, please create one manually in the azure portal to read and accept the Responsible AI terms. Once this is deployed, delete this and then use the above deployment button.

5. Enable Semantic Search on your Azure Cognitive Search Service:

   • On the left-nav pane, select Semantic Search (Preview).
   • Select either the Free plan or the Standard plan. You can switch between the free plan and the standard plan at any time.

6. Clone your Forked repo to your local machine or AML Compute Instance. If your repo is private, see below in Troubleshooting section how to clone a private repo.

7. Make sure you run the notebooks on a Python 3.10 conda enviroment

8. Install the dependencies on your machine (make sure you do the below comand on the same conda environment that you are going to run the notebooks:

pip install -r ./common/requirements.txt

9. Run the Notebooks in order. They build up on top of each other.

ssh-keygen -t ed25519 -C "[email protected]"

cat ~/.ssh/id_ed25519.pub
# Then select and copy the contents of the id_ed25519.pub file
# displayed in the terminal to your clipboard

git clone [email protected]:YOUR-USERNAME/YOUR-REPOSITORY.git