What is Azure Custom Vision?

The Azure Custom Vision API is a cognitive service that lets you build, deploy and improve custom image classifiers. An image classifier is an AI service that sorts images into classes (tags) according to certain characteristics. Unlike the Computer Vision service, Custom Vision allows you to create your own classifications.

What it does

The Custom Vision service uses a machine learning algorithm to classify images. You, the developer, must submit groups of images that feature and lack the classification(s) in question. You specify the correct tags of the images at the time of submission. Then, the algorithm trains to this data and calculates its own accuracy by testing itself on that same data. Once the model is trained, you can test, retrain, and eventually use it to classify new images according to the needs of your app. You can also export the model itself for offline use.

Classification and object detection

Custom Vision functionality can be divided into two features. Image classification assigns a distribution of classifications to each image. Object detection is similar, but it also returns the coordinates in the image where the applied tags can be found.

Optimization

In general, the methods that the Custom Vision service uses are robust to differences, which allows you to start prototyping with a small amount of data. 50 images per tag are generally a good start. This means, however, that the service is not optimal for detecting subtle differences in images (for example, detecting minor cracks or dents in quality assurance scenarios).

Additionally, you can choose from several varieties of the Custom Vision algorithm that are optimized for certain subject material—for example, landmarks or retail items. See the Build a classifier guide for more information on these.

What it includes

The Custom Vision Service is available as a set of native SDKs as well as through a web-based interface on the Custom Vision home page. You can create, test, and train a model through either interface, or both.

Custom Vision home page in a Chrome browser window

Next steps

Follow the Build a classifier guide to get started using Custom Vision on the web, or complete an Image classification tutorial to implement the scenario in code.