This article answers frequently asked questions about Azure Video Analyzer for Media (formerly Video Indexer).
What is Video Analyzer for Media?
Video Analyzer for Media is an artificial intelligence service that is part of Microsoft Azure Media Services. Video Analyzer for Media provides an orchestration of multiple machine learning models that enable you to easily extract deep insight from a video. To provide advanced and accurate insights, Video Analyzer for Media makes use of multiple channels of the video: audio, speech, and visual. Video Analyzer for Media’s insights may be used in many ways, like improving content discoverability and accessibility, creating new monetization opportunities, or building new experiences that use the insights. Video Analyzer for Media provides a web-based interface for testing, configuration, and customization of models in your account. Developers can use a REST-based API to integrate Video Analyzer for Media into production system.
What can I do with Video Analyzer for Media?
Some of the operations that Video Analyzer for Media can perform on media files include:
- Identifying and extracting speech and identify speakers.
- Identifying and extracting on-screen text in a video.
- Detecting objects in a video file.
- Identify brands (for example: Microsoft) from audio tracks and on-screen text in a video.
- Detecting and recognizing faces from a database of celebrities and a user-defined database of faces.
- Extracting topics discussed but not necessarily mentioned in audio and video content.
- Creating closed captions or subtitles from the audio track.
For more information and more Video Analyzer for Media features, see Overview.
How do I get started with Video Analyzer for Media?
Video Analyzer for Media includes a free trial offering that provides you with 600 minutes in the web-based interface and 2,400 minutes via the API. You can login to the Video Analyzer for Media web-based interface and try it for yourself using any web identity and without having to set up an Azure Subscription. Follow this easy introduction lab to get better idea of how to use Video Analyzer for Media.
To index videos and audio flies at scale, you can connect Video Analyzer for Media to a paid Microsoft Azure subscription. You can find more information on pricing on the pricing page.
You can find more information on getting started in Get started.
Do I need coding skills to use Video Analyzer for Media?
You can use the Video Analyzer for Media web-based interface to evaluate, configure, and manage your account with no coding required. When you are ready to develop more complex applications, you can use the Video Analyzer for Media API to integrate Video Analyzer for Media into your own applications, web sites, or custom workflows using serverless technologies like Azure Logic Apps or Azure Functions.
Do I need machine learning skills to use Video Analyzer for Media?
No, Video Analyzer for Media provides the integration of multiple machine learning models into one pipeline. Indexing a video or audio file via Video Analyzer for Media retrieves a full set of insights extracted on one shared timeline without any machine learning skills or knowledge on algorithms needed on the customer's part.
What media formats does Video Analyzer for Media support?
Video Analyzer for Media supports most common media formats. Refer to the Azure Media Encoder standard formats list for more details.
How do I upload a media file into Video Analyzer for Media and what are the limitations?
In the Video Analyzer for Media web-based portal, you can upload a media file using the file upload dialog or by pointing to a URL that directly hosts the source file (see example). Any URL that hosts the media content using an iFrame or embed code will not work (see example).
For more information, please see this how-to guide.
How long does it take Video Analyzer for Media to extract insights from media?
The amount of time it takes to index a video or audio file, both using the Video Analyzer for Media API and the Video Analyzer for Media web-based interface, depends on multiple parameters such as the file length and quality, the number of insights found in the file, the number of reserved units available, and whether the streaming endpoint is enabled or not. We recommend that you run a few test files with your own content and take an average to get a better idea.
Can I create customized workflows to automate processes with Video Analyzer for Media?
Yes, you can integrate Video Analyzer for Media into serverless technologies like Logic Apps, Flow, and Azure Functions. You can find more details on the Logic App and Flow connectors for Video Analyzer for Media here. You can see some automation projects done by partners in the Video Analyzer for Media Samples repo.
In which Azure regions is Video Analyzer for Media available?
You can see which Azure regions Video Analyzer for Media is available on the regions page.
Can I customize Video Analyzer for Media models for my specific use case?
Yes. In Video Analyzer for Media you can customize some of the available models to better fit your needs.
For example, our Person model supports out-of-the-box 1,000,000 faces of celebrity recognition, but you can also train it to recognize other faces which are not in that database.
Can I edit the videos in my library?
Yes. Press the edit video button from the library display or the open in editor button from the player display to get to the Projects tab. You can create a new project and add more videos from your library to edit them together, once you are done you can render your video and download.
If you want to get insights on your new video, index it with Video Analyzer for Media and it will appear in your library with its insights.
Can I index multiple audio streams or channels?
If there are multiple audio streams, Video Analyzer for Media takes the first one it encounters and will process only this stream. In any audio stream Video Analyzer for Media processes, it takes the different channels (if present) and processes them together as mono. For streams/channels manipulation you can use ffmpeg commands on the file before indexing it.
Can a storage account connected to the Media Services account be behind a firewall?
Your paid Video Analyzer for Media account uses the specified Media Services account that is connected to a storage account. Currently, to use the connected storage account that is behind firewall, you need to contact Video Analyzer for Media support and they will give the exact directions.
To open a new support request on Azure portal, navigate to support request.
What is the SLA for Video Analyzer for Media?
Azure Media Service’s SLA covers Video Analyzer for Media and can be found on the SLA page. The SLA only applies to Video Analyzer for Media paid accounts and does not apply to the free trial.
Are video and audio files indexed by Video Analyzer for Media stored?
Yes, unless you delete the file from Video Analyzer for Media, either using the Video Analyzer for Media website or API, your video and audio files are stored. For the free trial, the video and audio files that you index are stored in the Azure region East US. Otherwise, your video and audio files are stored in the storage account of your Azure subscription.
Can I delete my files that are stored in Video Analyzer for Media Portal?
Yes, you can always delete your video and audio files as well as any metadata and insights extracted from them by Video Analyzer for Media. Once you delete a file from Video Analyzer for Media, the file and its metadata and insights are permanently removed from Video Analyzer for Media. However, if you have implemented your own backup solution in Azure storage, the file remains in your Azure storage.
Can I control user access to my Video Analyzer for Media account?
Yes, only account admins can invite and uninvite people to their accounts, as well as assign who has editing privileges and who has read-only access.
Who has access to my video and audio files that have been indexed and/or stored by Video Analyzer for Media and the metadata and insights that were extracted?
Your video or audio content that have public as its privacy setting can be accessed by anyone who has the link to your video or audio content and its insights. Your video or audio content that have private as its privacy setting can only be accessed by users that were invited to the account of the video or audio content. The privacy setting of your content also applies to the metadata and insights that Video Analyzer for Media extracts. You assign the privacy setting when you upload your video or audio file. You can also change the privacy setting after indexing.
What access does Microsoft have to my video or audio files that have been indexed and/or stored by Video Analyzer for Media and the metadata and insights that were extracted?
Per the Azure Online Services Terms (OST), you completely own your content, and Microsoft will only access your content and the metadata and insights that Video Analyzer for Media extracts from your content according to the OST and the Microsoft Privacy Statement.
Are the custom models that I build in my Video Analyzer for Media account available to other accounts?
No, the custom models that you create in your account are not available to any other account. Video Analyzer for Media currently allows you to build custom brands, language, and person models in your account. These models are only available in the account in which you created the models.
Is the content indexed by Video Indexer kept within the Azure region where I am using Video Indexer?
Yes, the content and its insights are kept within the Azure region (except for Singapore and Brazil South regions) unless you have a manual configuration in your Azure subscription that uses multiple Azure regions.
Customer data in a region is replicated for BCDR reasons to the paired region.
Video Analyzer for Media is covered by the Microsoft Privacy Statement. The privacy statement explains the personal data Microsoft processes, how Microsoft processes it, and for what purposes Microsoft processes it. To learn more about privacy, visit the Microsoft Trust Center.
What certifications does Video Analyzer for Media have?
Video Analyzer for Media currently has the SOC certification. To review Video Analyzer for Media's certification, please refer to the Microsoft Trust Center.
What is the difference between private and public videos?
When videos are uploaded to Video Analyzer for Media, you can choose from two privacy settings: private and public. Public videos are accessible for anyone, including anonymous and unidentified users. Private ones are restricted solely to the account members.
I tried to upload a video as public and it was flagged for inappropriate or offensive content, what does that mean?
When uploading a video to Video Analyzer for Media, an automatic content analysis is done by algorithms and models in order to make sure no inappropriate content will be presented publicly. If a video is found to be suspicious as containing explicit content, it will not be possible to set it as public. However, the account members can still access it as a private video (view it, download the insights and extracted artifacts, and perform other operations available to account members).
In order to set the video for public access, you can either:
Build your own interface layer (such as app or website) and use it to interact with the Video Analyzer for Media service. This way the video remains private in our portal and your users can interact with it through your interface. For example, you can still get the insights or allow viewing of the video in your own interface.
Request a human review of the content, which would result in removing of the restriction assuming the content is not explicit.
This option can be explored if the Video Analyzer for Media website is used directly by your users as the interface layer, and for public (unauthenticated) viewing.
What APIs does Video Analyzer for Media offer?
Video Analyzer for Media's APIs allows for indexing, extracting metadata, asset management, translation, embedding, customization of models and more. To find more detailed information on using the Video Analyzer for Media API, refer to the Video Analyzer for Media Developer Portal.
What client SDKs does Video Analyzer for Media offer?
There are currently no client SDKs offered. The Video Analyzer for Media team is working on the SDKs and plans to deliver them soon.
How do I get started with Video Analyzer for Media's API?
What is the difference between the Video Analyzer for Media API and the Azure Media Service v3 API?
Currently there are some overlaps in features offered by the Video Analyzer for Media API and the Azure Media Service v3 API. You can find more information on how to compare both services here.
What is an API access token and why do I need it?
The Video Analyzer for Media API contains an Authorization API and an Operations API. The Authorizations API contains calls that give you access token. Each call to the Operations API should be associated with an access token, matching the authorization scope of the call.
Access tokens are needed to use the Video Analyzer for Media APIs for security purposes. This ensures that any calls are coming from you or those who have access permissions to your account.
What is the difference between Account access token, User access token, and Video access token?
- Account level – account level access tokens let you perform operations on the account level or the video level. For example, upload a video, list all videos, get video insights.
- User level - user level access tokens let you perform operations on the user level. For example, get associated accounts.
- Video level – video level access tokens let you perform operations on a specific video. For example, get video insights, download captions, get widgets, etc.
How often do I need to get a new access token? When do access tokens expire?
Access tokens expire every hour, so you need to generate a new access token every hour.
What are the login options to Video Analyzer for Media Developer portal?
See a release note regarding login information.
Once you register your email account using an identity provider, you cannot use this email account with another identity provider.
How much does Video Analyzer for Media cost?
Video Analyzer for Media uses a simple pay-as-you-go pricing model based on the duration of the content input that you index. Additional charges may apply for encoding, streaming, storage, network usage, and media reserved units. For more information, see the pricing page.
When am I billed for using Video Analyzer for Media?
When sending a video to be indexed, the user will define the indexing to be video analysis, audio analysis or both. This will determine which SKUs will be charged. If there is a critical level error during processing, an error code will be returned as a response. In such a case, no billing occurs. A critical error can be caused by a bug in our code or a critical failure in an internal dependency the service has. Errors such as wrong identification or insight extraction are not considered as critical and a response is returned. In any case where a valid (non-error code) response is returned, billing occurs.
Does Video Analyzer for Media offer a free trial?
Yes, Video Analyzer for Media offers a free trial that gives full service and API functionality. There is a quota of 600 minutes worth of videos for web-based interface users and 2,400 minutes for API users.