Solution Idea
If you'd like to see us expand this article with more information, such as potential use cases, alternative services, implementation considerations, or pricing guidance, let us know with GitHub Feedback!
The bot assistant with search integration can help your customers have interactions with your business application and provide suggestions based on the visual information.
Potential use cases
This solution can be used broadly but is ideal for the retail industry, as well as the travel and hospitality industries.
Architecture
Dataflow
- The user uses the application, which is hosted on Azure App Service, either via web browser or mobile device
- Azure App Service communicates with Azure Bot Service in order to facilitate the user/application interaction
- Azure Bot Service leverages Azure Cognitive Services Language Understanding in order to understand the user natural by identifying user intents and entities
- Language Understanding (LUIS) returns back to the Azure Bot the identified user intent based on conversation made
- Azure Bot passes a kind of visual context input (e.g image) to the Azure Bing Visual Search API
- Visual Search returns output back to Azure Bot Service
- Optionally, the Azure Bot receives more information for user queries exclusively from the user's domain using the Azure Custom Search API
- Custom Search API returns output back to Bot Service
Components
- Azure App Service
- Azure Bot Service
- Azure Cognitive Services Language Understanding
- Azure Bing Visual Search API
- Azure Custom Search API
Next steps
- What are Azure Cognitive Services?
- What is Language Understanding (LUIS)?
- What is the Azure Bing Search API?
- Introduction to Bot Framework Composer