Object detection

  • Article

Important

This content is archived and is not being updated. For the latest documentation, see Microsoft Power Platform product documentation. For the latest release plans, see Dynamics 365 and Microsoft Power Platform release plans.

Enabled for Public preview General availability
Admins, makers, or analysts, automatically - This feature is released. Apr 2, 2020

Feature details

Object detection has been released for General availability in AI Builder; therefore, it requires AI Builder capacity add-on licensing.

When your business process involves recognizing or counting objects, you can use object detection in AI Builder to automate the process using images. Object detection with AI Builder improves the automation of your business processes in two steps:

  1. Build and train your AI model to recognize objects (such as products or parts) in images.
  2. Solve your end-to-end business problems by using your AI model in Power Apps. These apps can detect and count objects that are captured by the device’s camera.

We've added many improvements since the last release to streamline the user experience and to increase the accuracy of object detection models.

  • Manual object name definition: AI Builder allows customers who don’t have their object names in Common Data Service to provide their list of object names by typing them directly in the experience.
  • Model specialization: You can select a specialization mode that will increase the accuracy for specific kind of object detection. The new mode is product retail detection that will improve recognition of object on shelves and brand detection to help you recognize brand in images.
  • Support for data connections in the experience: The experience to upload images in object detection has been extended to support importing images from SharePoint, OneDrive, and Azure blob storage. Users can now get all the images they need without leaving the AI Builder experience.
  • Improved PCF control: The control now exposes additional information like the confidence score of each detected object. This information can be used to build more tailored business processes in your apps.

Geographic areas

This feature will be released into the following Microsoft Azure geographic areas:

  • United States
  • Europe
  • Asia Pacific
  • United Kingdom
  • Australia
  • Canada

See also

Overview of object detection model (docs)