Content moderation reviews, workflows, and jobs

Content Moderator combines machine-assisted moderation with human-in-the-loop capabilities to create an optimal moderation process for real-world scenarios. It does this through the cloud-based Review tool. In this guide, you'll learn about the core concepts of the Review tool: reviews, workflows, and jobs.

Reviews

In a review, content is uploaded to the Review tool. You can view it by clicking its content type under Review tab on the dashboard. From the review screen, you can alter the applied tags and apply your own custom tags as appropriate. When you submit a review, the results are sent to a specified callback endpoint, and the content is removed from the site.

The Review drop-down menu is highlighted. It shows these content types: Image, Text, and Video.

Manage reviews

From the dashboard, navigate to Admin -> Manage Reviews to view the admin screen. Here, you can see a list of all reviews (pending and completed).

The three-dot Actions button on each review lets you go to the review screen or inspect the history of that review.

Review tool website, on the Review screen

Use the Search toolbar to sort the reviews by a variety of categories such as review state, tags, content type, subteams, assigned users, and created/modified date.

The Search toolbar is shown. It has various combo boxes for entering search criteria, such as Review State and Tags.

See the Review tool guide to get started creating reviews, or see the API console guide to learn how to do so programmatically.

Workflows

A workflow is a cloud-based customized filter for content. Workflows can connect to a variety of services to filter content in different ways and then take the appropriate action. With the Content Moderator connector, a workflow can automatically apply moderation tags and create reviews with submitted content.

View workflows

To view your existing workflows, go to the Review tool and select Admin > Workflows.

Default workflow

Workflows are defined as JSON strings, which makes them accessible programmatically. If you select the Edit option for your workflow and then select the JSON tab, you'll see a JSON expression like the following:

{
    "Type": "Logic",
    "If": {
        "ConnectorName": "moderator",
        "OutputName": "isAdult",
        "Operator": "eq",
        "Value": "true",
        "Type": "Condition"
        },
    "Then": {
    "Perform": [
    {
        "Name": "createreview",
        "CallbackEndpoint": null,
        "Tags": []
    }
    ],
    "Type": "Actions"
    }
}

See the Review tool guide to get started creating and using workflows, or see the API console guide to learn how to do so programmatically.

Jobs

A moderation job serves as a kind of wrapper for the functionality of content moderation, workflows, and reviews. The job scans your content using the Content Moderator image moderation API or text moderation API and then checks it against the designated workflow. Based on the workflow results, it may or may not create a review for the content in the Review tool. While both reviews and workflows can be created and configured with their respective APIs, the job API allows you to obtain a detailed report of the entire process (which can be sent to a specified callback endpoint).

See the API console guide to get started using jobs.

Next steps