Retail Assistant with Visual Capabilities using Cognitive Services

Solution Idea

If you'd like to see us expand this article with more information (implementation details, pricing guidance, code examples, etc), let us know with GitHub Feedback!

The retail assistant or vacation planner can help your customers have interactions with your business bot and provide suggestions based on the visual information.

Architecture

Architecture diagram Download an SVG of this architecture.

Data Flow

  1. Users interact with your business assistant
  2. Assistant understands context from LUIS
  3. Assistant passes visual context to the Bing Visual Search API
  4. Optionally Bot gets more information for user queries exclusively from your domain using the Bing Custom Search API