Content Moderator overview

Content moderation is the process of monitoring user-generated content on online and social media websites, chat and messaging platforms, enterprise environments, gaming platforms, and peer communication platforms. The goal is to track, flag, assess, and filter out offensive and unwanted content that creates risk for your organization. Moderated content might include text, images, and videos.

Why moderate content?

Moderating text, image, and video content has multiple benefits:

  • Text moderation benefits communities, family-based websites, in-game communities, chat and messaging platforms, and user-generated content marketing.
  • Image moderation works great for ensuring that profile pictures, social media posts, and business documents are appropriate. Using moderation on image-sharing sites saves resources by providing a first-level scan and by flagging potentially damaging content.
  • Video moderation is designed for video publishing sites, news sites, and video content sites. Use it anywhere that videos are likely to be uploaded.

Integrated tools

Content moderation in Content Moderator consists of several web service APIs that augment human reviews, and the review tool:

Content Moderator block diagram

Content Moderator uses the following APIs:

  • Text Moderation: Use to scan and tag text.
  • Image Moderation: Use to scan and tag images.
  • Video Moderation: Use to scan and tag videos.
  • Review: Use to create jobs, reviews, and workflows in the review tool.
  • List Management: Use to moderate with custom lists of images and text, pre-identified content that you don’t need to scan again.

Get started with the review tool

The Content Moderator review tool is a good way to test drive the Content Moderator APIs.The Review tool internally calls the automated moderation APIs, and then presents the items for review, right in your web browser. In the Review tool, you can invite other users to review content, track pending invites, and assign permissions to team members.

Use the Review API to scan content in bulk and review tagged images or text in the Review tool. Provide your API callback point so that you are notified when reviewers submit their moderation decisions. You use this feature to automate post-review workflows by integrating it with your own systems.

Use the automated moderation APIs

If you sign up for the review tool, to get your free tier key, select Settings > Credentials. Your subscription key is the value in the Ocp-Apim-Subscription-Key box as shown in the Credentials article.

You can also sign up in Azure for the Content Moderator API. Use the APIs to automatically moderate large amounts of content, and integrate with your review tools and processes. While you’re at it, apply to use the private preview of the Video Moderation API.

Your Content Moderator API subscription key

Next steps

Use the Quickstart to get started with Content Moderator.