Media Analytics on the Media Services platform

Retirement plans


Some media processors are being retired. For the retirement dates and more information, see the legacy components topic.


More organizations are using video as the preferred medium to train their employees, engage their customers, and document business functions. Cloud computing provides a way to store, stream, and access these large media files. But as a company's library of video content grows, it needs an equally effective means of extracting insights from the content.

To address this growing need, Azure Media Services offers Azure Media Analytics. Media Analytics is a collection of speech and vision components that makes it easier for organizations and enterprises to derive actionable insights from their video files. Built by using the core Media Services platform components, Media Analytics can handle media processing at scale on day one.

With Media Analytics, developers can quickly bring advanced video functionality into applications. It provides enterprise environments with the full scale, compliance, security, and global reach required by large organizations.

The following diagram shows Media Analytics and other major parts of the Media Services platform.

VoD workflow

Media Analytics media processors produce MP4 files or JSON files. If a media processor produces an MP4 file, you can progressively download the file. If a media processor produces a JSON file, you can download the file from Azure Blob storage.

Media Analytics services


With Azure Media Indexer, you can make content searchable and generate closed-captioning tracks. For detailed information and examples, see Indexing Media Files with Azure Media Indexer.

Motion Detector

You can use Motion Detector to detect motion in a video with stationary backgrounds. This makes it possible to check for false positives on motion events detected by surveillance cameras. For detailed information and examples, see Motion detection for Azure Media Analytics.

Face Detector

By using Face Detector, you can detect people’s faces and their emotions, including happiness, sadness, and surprise. This has several useful industry applications, described later, including aggregating and analyzing reactions of people attending an event. For detailed information and examples, see Face and emotion detection for Azure Media Analytics.

Video summarization

Video summarization can help you create summaries of long videos by automatically selecting interesting snippets from the source video. This ability is useful when you want to provide a quick overview of what to expect in a long video. For detailed information and examples, see Use Azure Media Video Thumbnails to create video summarization.

Optical character recognition

With Azure Media OCR (optical character recognition), you can convert text content in video files into editable, searchable digital text. You can then automate the extraction of meaningful metadata from the video signal of your media.

Scalable face redaction

Azure Media Redactor is a Media Analytics media processor that offers scalable face redaction in the cloud. By using face redaction, you can modify your video to blur faces of selected individuals. You might want to use the face redaction service in news media or when public safety is involved. A few minutes of footage that contains multiple faces can take hours to redact manually, but with this service, face redaction takes just a few simple steps. For more information, see the Redact faces with Azure Media Analytics article.

Content Moderation

Azure Content Moderator enables you to use machine-assisted moderation for your videos. For example, you might want to detect possible adult and racy content in videos and review the flagged content by your human moderation teams. Manually moderating videos for undesirable content is a time consuming and expensive task. With this service and associated review tools, you combine machine-assisted moderation with human-in-the-loop capabilities for best results efficiently and cost-effectively. To learn more, see the Process your videos with Azure Content Moderator article.

Common scenarios

Media Analytics can help organizations and enterprises glean new insights from video and more effectively manage large volumes of video content. Here are several scenarios:

  • Call centers. Even with the advent of social media, customer call centers still facilitate a large percentage of customer-service transactions. Encoded in this audio data is a large amount of customer information that can be analyzed to achieve higher customer satisfaction. By using Media Indexer, organizations can extract text and build search indexes and dashboards. Then they can extract intelligence around common complaints, sources of complaints, and other relevant data.
  • User-generated content moderation. From news media outlets to police departments, many organizations have public-facing portals that accept user-generated media such as videos and images. The volume of content can spike due to unexpected events. In these scenarios, it is difficult to conduct effective manual reviews of content for appropriateness. Customers can rely on the content-moderation service to focus on content that is appropriate.

Media Analytics media processors

This section lists the Media Analytics media processors and shows how to use .NET or REST to get a media processor (MP) object.

MP names

  • Azure Media Indexer
  • Azure Media Face Detector
  • Azure Media Motion Detector
  • Azure Media Video Thumbnails
  • Azure Media OCR
  • Azure Media Content Moderator


The following function takes one of the specified MP names and returns an MP object.

static IMediaProcessor GetLatestMediaProcessorByName(string mediaProcessorName)
    var processor = _context.MediaProcessors
        .Where(p => p.Name == mediaProcessorName)
        .OrderBy(p => new Version(p.Version))

    if (processor == null)
        throw new ArgumentException(string.Format("Unknown media processor",

    return processor;



GET$filter=Name%20eq%20'Azure%20Media%20OCR' HTTP/1.1
DataServiceVersion: 1.0;NetFx
MaxDataServiceVersion: 3.0;NetFx
Accept: application/json
Accept-Charset: UTF-8
User-Agent: Microsoft ADO.NET Data Services
Authorization: Bearer <token>
x-ms-version: 2.19


. . .

         "Description":"Azure Media OCR",
         "Name":"Azure Media OCR",


See Azure Media Analytics demos.

Provide feedback

Use the User Voice forum to provide feedback and make suggestions on how to improve Azure Media Services. You also can go directly to one of the following categories:

See Media Services Analytics announcement.

Next steps

Review Media Services learning paths.

Media Services v3 (latest)

Check out the latest version of Azure Media Services!

Media Services v2 (legacy)