monamehrotraibm / watson-assistant Goto Github PK

Below is the explanation of the flow diagram:

• User/Channel: User, using channels such as mobile, web page, slack, teams, Facebook messenger, starts conversation with watson assistant

• Intent Understanding: Watson Assistant’s Dialog skills understand the intent with the help of intent reasoning and entities

• Webhook: If the processed intent node has webhook functionality enabled for it, it sends the data saved in the form of context variable to the web function

• API call: Web function calls an API which processes the task and returns a json response

• Response: Response gets displayed on the watson assistant's chat window

The architecture above introduces five features that can integrate voice functionality along with Watson Assistant.

• Web page: this is the HTML page where we integrate the microphone button with Watson Assistant. This HTML file also contains a Javascript file for running all the APIs and a CSS file for setting the microphone position.

• Speech to Text: This is the IBM cloud service known as Speech to Text, which converts speech to text so we can pass the text to Watson Assistant. When the user clicks the microphone button, the voice recording will start, and when the user deselects the microphone button, the recording will stop, and the audio file will be sent to the STT service. SST has a training model that can identify the words and uses NLP models. SST contains more than 70 custom models for the user. In addition, you can create your own if needed.

• Watson Assistant: This is Watson Assistant one of the most important parts of this architecture. The SST service passes the converted text to Watson Assistant, which gives the answers to the user queries in text form. The user needs to train and set up the intents on IBM Cloud so that Watson Assistant can understand the user queries.

• Text to Speech: This is an IBM service known as Text to Speech. It takes the text input from Watson Assistant and converts it to speech, and we can play the audio file in the user's browser so that the user can hear the voice response.

• Web function: it is also known as IBM cloud function. This function helps to retrieve data from various APIs. The user can get the response from any external API, so this web function connects the external APIs with Watson Assistant. We can say that the web function is the bridge between Watson Assistant and external services, for example. We can connect Wikipedia API with Watson Assistant, so the user can ask a question to WA and WA will get the answer from Wikipedia API.