Echo Dot (3rd Gen) - Smart speaker with Alexa - Charcoal

Use your voice to play a song, artist, or genre through Amazon Music, Apple Music, Spotify, Pandora, and others. With compatible Echo devices in different rooms, you can fill your whole home with music.

Buy Now

Wireless Rechargeable Battery Powered WiFi Camera.

Wireless Rechargeable Battery Powered WiFi Camera is home security camera system lets you listen in and talk back through the built in speaker and microphone that work directly through your iPhone or Android Mic.

Buy Now

Build a dynamic avatar-based mobile chatbot powered with AI and AR capabilities – IBM Developer

0
82


Summary

This code pattern demonstrates how to build a dynamic, real-time avatar-based chatbot, which is an Android mobile application with AI and AR capabilities. This mobile app dynamically fetches the information using APIs in Watson Assistant by using webhooks (in IBM Cloud Functions).

Description

Customers are quickly becoming used to communicating with chatbots while at a store or while on the company’s website. Adding AI and AR capabilities to chatbots create a range of possibilities that have not been used before. By taking advantage of the mobile, AI, and AR capabilities that are readily available in the IBM Cloud catalog — IBM Cloud Functions, IBM Mobile Foundation, Watson Assistant, and Watson Text to Speech and Speech to Text services — you can quickly build an avatar-based chatbot that runs on your Android mobile device.

Flow

Architecture diagram for building a dynamic avatar-based mobile chatbot

  1. User asks a query to the AR Avatar (mobile app).
  2. Mobile application converts the speech to text using Watson speech to text and sends the query to IBM Mobile Foundation.
  3. IBM Mobile Foundation securely passes the query to Watson Assistant.
  4. Watson Assistant triggers the appropriate IBM Cloud Function, based on the query received.
  5. Based on the query, IBM Cloud Function triggers the appropriate service or services, in the backend server application.
  6. Backend server application returns the response for the query.
  7. IBM Cloud Function sends the response to Watson Assistant.
  8. Watson Assistant frames a response to reply to the user and sends it to IBM Mobile Foundation.
  9. IBM Mobile Foundation securely sends the response to the mobile application.
  10. Mobile application converts the text into speech using Watson Text to Speech.
  11. Mobile application replies to the user using the AR Avatar.

Instructions

Ready to get started? Check out the README for detailed instructions how to:

  1. Create Watson services with IBM Cloud.
  2. Update the details in the backend application.
  3. Deploy the backend application.
  4. Setup IBM Cloud Functions.
  5. Setup Watson Assistant.
  6. Setup IBM Mobile Foundation Server and CLI.
  7. Setup Google Cloud Anchors.
  8. Configure the Android mobile app.
  9. Build and run Android mobile app.

Manoj Jahgirdar

Rahul Reddy Ravipally

Neha

Amol Dhonse

Manjula G Hosurmath



Read More

LEAVE A REPLY

Please enter your comment!
Please enter your name here