Extract insights from a video or live stream by using Azure Video Indexer

Extracting insights from videos or live streams can be a valuable tool in various domains, such as content management, customer support, marketing analysis, and more. With Azure Video Indexer, you can harness the power of artificial intelligence to automatically analyze and extract valuable information from your video content. In this article, we will explore how you can use Azure Video Indexer to extract insights from videos and live streams and implement them in a Microsoft Azure AI solution.

Azure Video Indexer Overview

Azure Video Indexer is a cloud-based service that uses AI algorithms to extract insights from video and audio files. It can analyze a wide range of content types, including recorded videos, live streams, and even audio files. The insights extracted by Video Indexer include:

• Speech-to-text transcription
• Face detection and recognition
• Speaker identification
• Object detection
• Sentiment analysis
• And more…

To get started with Azure Video Indexer, you need to create a Video Indexer resource in your Azure subscription. Once you have the resource set up, you can start uploading your video content for analysis. Video Indexer provides APIs and SDKs that you can use to interact with the service programmatically.

Extracting Insights from Videos and Live Streams

Let’s walk through an example scenario to see how we can use Azure Video Indexer to extract insights from a video and implement them in an AI solution. Suppose you are working on a customer support application, and you want to extract the spoken content from customer interaction videos and analyze it for sentiment analysis.

First, you need to upload the customer interaction videos to Azure Video Indexer. You can use the Video Indexer API to programmatically upload the videos. Once the videos are uploaded, Video Indexer will automatically generate a unique video ID for each video.

Next, you can use the Video Indexer API to retrieve the insights for a specific video. You can specify the video ID in the API request to retrieve the desired insights. In our case, we are interested in the speech-to-text transcription and sentiment analysis.

GET https://api.videoindexer.ai/{location}/Accounts/{accountId}/Videos/{videoId}/Index?accessToken={accessToken}&language=English

In the API response, you will receive the speech-to-text transcription for the video. The transcription will include the timestamp for each spoken word or sentence. You can extract the transcribed text and perform sentiment analysis using Azure Cognitive Services Text Analytics API. The Text Analytics API can analyze the sentiment of the extracted text and return a sentiment score.

To analyze the sentiment using the Text Analytics API, you need to create a Text Analytics resource in your Azure subscription. Once you have the resource set up, you can use the Text Analytics API to analyze the extracted text for sentiment.

POST https://.api.cognitive.microsoft.com/text/analytics/v3.1-preview.3/sentiment


In the API request body, you can include the transcribed text and specify the language for sentiment analysis. The Text Analytics API will return a sentiment score for the text, ranging from 0 (negative sentiment) to 1 (positive sentiment).

Implementing Insights in your AI Solution

Now that you have the sentiment scores for the customer interaction videos, you can implement them in your AI solution. For example, you can categorize customer interactions based on sentiment scores and prioritize follow-up actions based on negative sentiment. You can also generate reports or visualizations to analyze the overall customer sentiment trends.

In conclusion, Azure Video Indexer enables you to extract valuable insights from videos and live streams using AI algorithms. By combining the power of Video Indexer with other Azure services like Text Analytics, you can enhance your AI solutions with advanced analysis capabilities. Whether it’s for content management, customer support, or marketing analysis, Azure Video Indexer provides a powerful platform to unlock the potential of your video content.