Use the object detection model in Power Automate

  1. Sign in to Power Automate, select the My flows tab, and then select New > +Instant-from blank.

  2. Name your flow, select Manually trigger a flow under Choose how to trigger this flow, and then select Create.

  3. Expand Manually trigger a flow, select +Add an input, select File as the input type, and set as input title My Image.

  4. Select + New step, search for AI Builder in the Search for filters and actions box, and then select Detect and count objects in images in the list of actions.

  5. Select the object detection model you want to use, and in the Image field, specify My Image from the trigger:

    Specify my image

  6. To retrieve the name of the detected object or objects on the image, use the Detected object name field.

Congratulations! You've created a flow that uses an object detection AI Builder model. Select Save in the upper-right corner, and then select Test to try out your flow.

Example object detection flow

The following example shows the creation of a flow that is triggered by an image. This flow counts the number of green tea bottles in the image.

Green tea object detection flow example

To learn more about all the triggers and actions you can use, see the Power Automate documentation.

Parameters

Input

Name Required Type Description Values
AI Model Yes model Object detection model to use for analysis Trained and published object detection models
Image Yes file Image to process

Output

Name Type Description Values
Detected object name string The detected object name Among the tags defined at model creation
Detected object ID string The detected object ID
Confidence score float How confident the model is in its prediction Value in the range of 0 to 1. Values close to 1 indicate greater confidence that the extracted value is accurate
Coordinates height float Coordinates left of the object
Coordinates left float Coordinates left of the object
Coordinates top float Coordinates top of the object
Coordinates width float Coordinates width of the object

See also

Overview of the object detection model