What is Azure Custom Vision?
The Azure Custom Vision API is a cognitive service that lets you build, deploy and improve custom image classifiers. An image classifier is an AI service that sorts images into classes (tags) according to certain characteristics. Unlike the Computer Vision service, Custom Vision allows you to create your own classifications.
What it does
The Custom Vision service uses a machine learning algorithm to classify images. You, the developer, must submit groups of images that feature and lack the classification(s) in question. You specify the correct tags of the images at the time of submission. Then, the algorithm trains to this data and calculates its own accuracy by testing itself on that same data. Once the model is trained, you can test, retrain, and eventually use it to classify new images according to the needs of your app. You can also export the model itself for offline use.
Classification and object detection
Custom Vision functionality can be divided into two features. Image classification assigns a distribution of classifications to each image. Both multiclass (one tag per image) and multilabel (any number of tags per image) classification models are supported. Object detection is similar to multilabel classification, but it also returns the coordinates in the image where the applied labels can be found.
In general, the methods that the Custom Vision service uses are robust to differences, which allows you to start prototyping with a small amount of data. 50 images per tag are generally a good start. This means, however, that the service is not optimal for detecting subtle differences in images (for example, detecting minor cracks or dents in quality assurance scenarios).
Additionally, you can choose from several varieties of the Custom Vision algorithm that are optimized for certain subject material—for example, landmarks or retail items. See the Build a classifier guide for more information on these.
What it includes
The Custom Vision Service is available as a set of native SDKs as well as through a web-based interface on the Custom Vision home page. You can create, test, and train a model through either interface, or both.
Data privacy and security
As with all of the Cognitive Services, developers using the Custom Vision service should be aware of Microsoft's policies on customer data. See the Cognitive Services page on the Microsoft Trust Center to learn more.