If you'd like to see us expand this article with more information, implementation details, pricing guidance, or code examples, let us know with GitHub Feedback!
Visual assistant provides rich information based on content of the image with capabilities such as reading business card, identifying barcode, and recognizing popular people, places, objects, artworks, and monuments.
Download an SVG of this architecture.
- Users interact with bot
- Bot understands context from LUIS
- Bot passes visual context to the Bing Visual Search API
- Bot gets additional information from Bing Entity Search for rich context on people, place, artwork, monument, and objects.
- Bot gets additional information for barcodes.
- Optionally Bot gets more information on barcodes/queries exclusively from your domain through the Bing Custom Search API.
- Assistant renders similar products/destinations from your domain or provides more information around celebrity/place/monuments/artworks.