Concepts

It is essential to have the necessary skills and knowledge to leverage the available tools and technologies. This article will guide you through the process of selecting and including the built-in skills required for creating effective AI solutions on Azure. Let’s dive in!

1. Understanding Azure AI Capabilities

Azure provides a wide range of AI capabilities that can be integrated into your applications. These include natural language processing, speech recognition, computer vision, and more. Familiarizing yourself with these capabilities will help you determine the most suitable skills for your specific AI solution.

2. Identifying the Problem Statement

Before selecting the built-in skills, it is important to understand the problem you are trying to solve. Determine the key requirements and objectives of your AI solution. For example, if you are building a chatbot, you might need language understanding and generation skills to interact with users effectively.

3. Reviewing Cognitive Services

Azure Cognitive Services offer a collection of APIs and pre-trained models that can be easily integrated into your applications. Explore the various Cognitive Services available, such as Text Analytics, Face, and Speech, and select the ones that align with your solution’s requirements.

For instance, if you need to extract key phrases from a given text, the Text Analytics service can offer the necessary skill. You can implement it using the following code:

const keyPhrasesUrl = `${baseEndpoint}/text/analytics/v3.0/keyphrases`;

const document = {
documents: [
{ id: "1", language: "en", text: "Azure Cognitive Services provide a variety of powerful AI capabilities." }
]
};

fetch(keyPhrasesUrl, {
method: "POST",
headers: {
"Ocp-Apim-Subscription-Key": subscriptionKey,
"Content-Type": "application/json"
},
body: JSON.stringify(document)
})
.then(response => response.json())
.then(response => {
console.log("Extracted key phrases:", response.documents[0].keyPhrases);
})
.catch(error => console.error(error));

4. Customizing with Azure Machine Learning

If the built-in Cognitive Services do not fully meet your requirements, you can leverage Azure Machine Learning to create custom models and skills. This allows you to train models using your own data and refine their performance based on your specific needs.

By using the AutoML capabilities in Azure Machine Learning, you can automate the process of training and deploying models. This snippet demonstrates how to train an image classification model:

const classificationDataset = azureMachineLearning.datasets.retrieve(
subscriptionId, resourceGroup, workspaceName, datasetName
);

const classificationExperiment = azureMachineLearning.experiments.create(
subscriptionId, resourceGroup, workspaceName, experimentName
);

const classificationModel = azureMachineLearning.classification.train(
subscriptionId, resourceGroup, workspaceName, experimentName, classificationDataset
);

const classificationModelName = classificationModel.name;

5. Integrating Azure Bot Service

For AI-driven customer interactions, Azure Bot Service provides an integrated environment to build conversational bots. It leverages the power of Azure AI and allows you to create intelligent and context-aware chatbots that can comprehend natural language and perform complex tasks.

By utilizing the Bot Framework SDK and Azure Bot Service, you can easily design, develop, and deploy bots. This sample code demonstrates creating a bot using Bot Framework SDK in C#:

public class GreetingBot : ActivityHandler
{
protected override async Task OnMessageActivityAsync(ITurnContext turnContext, CancellationToken cancellationToken)
{
// Get user message
var userMessage = turnContext.Activity.Text;

// Perform bot actions based on user message
if (string.Equals(userMessage, "Hello", StringComparison.OrdinalIgnoreCase))
{
await turnContext.SendActivityAsync("Hi! How can I assist you today?");
}
else
{
await turnContext.SendActivityAsync("Sorry, I didn't understand that.");
}
}
}

// Register the bot
BotFrameworkAdapter botAdapter = new BotFrameworkAdapter();
botAdapter.Use(new AuthorizationMiddleware());
botAdapter.ProcessAsync(Request, Response, botInstance);

In conclusion, designing and implementing a Microsoft Azure AI solution requires a thoughtful selection and integration of built-in skills. By understanding Azure AI capabilities, identifying the problem statement, reviewing Cognitive Services, customizing with Azure Machine Learning, and integrating Azure Bot Service, you can build effective AI solutions tailored to your specific requirements. Happy coding!

Answer the Questions in Comment Section

Which of the following best describes the purpose of the “Evaluate Document” skill in Azure Cognitive Search?

a) It extracts key phrases and recognizes entities from unstructured text sources.

b) It returns potential key phrases and offers suggestions for relevant documents.

c) It ranks documents based on their relevance to a specific query or search pattern.

d) It applies pre-built AI models to understand the sentiment and emotions expressed in a document.

Correct answer: c) It ranks documents based on their relevance to a specific query or search pattern.

True or False: The “Optical Character Recognition (OCR)” skill in Azure Cognitive Search can convert handwritten text into machine-readable text.

Correct answer: True

Which of the following are valid input formats for the “Entity Recognition” skill in Azure Cognitive Search? (Select all that apply)

a) Text documents

b) Images

c) Audio files

d) PDF files

Correct answers: a) Text documents, b) Images, d) PDF files

What is the purpose of the “Language Detection” skill in Azure Cognitive Search?

a) It determines the primary language used within a given document.

b) It translates text from one language to another.

c) It identifies key concepts and terms within a document.

d) It recognizes and extracts information about people, locations, and organizations mentioned in a document.

Correct answer: a) It determines the primary language used within a given document.

True or False: The “Key Phrase Extraction” skill in Azure Cognitive Search can detect and extract personally identifiable information (PII) from documents.

Correct answer: False

Which skill in Azure Cognitive Search can be used to identify and extract structured data from unstructured documents?

a) Text Analytics

b) Optical Character Recognition (OCR)

c) Form Recognizer

d) Speech-to-Text

Correct answer: c) Form Recognizer

The “Text Analytics” skill in Azure Cognitive Search provides which of the following capabilities? (Select all that apply)

a) Sentiment analysis

b) Language detection

c) Named entity recognition

d) Spell checking

Correct answers: a) Sentiment analysis, b) Language detection, c) Named entity recognition

True or False: The “Custom Entity” skill in Azure Cognitive Search allows you to define your own custom entities to recognize in a document.

Correct answer: True

Which skill in Azure Cognitive Search can extract structured information from invoices, receipts, and purchase orders?

a) Optical Character Recognition (OCR)

b) Language Detection

c) Named Entity Recognition

d) Form Recognizer

Correct answer: d) Form Recognizer

The “Sentiment Analysis” skill in Azure Cognitive Search is used to:

a) Assign a numerical score to text indicating positive, negative, or neutral sentiment.

b) Translate text from one language to another.

c) Extract phrases and terms related to specific topics from a document.

d) Identify and extract personally identifiable information (PII) from documents.

Correct answer: a) Assign a numerical score to text indicating positive, negative, or neutral sentiment.

0 0 votes
Article Rating
Subscribe
Notify of
guest
27 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
Emilia Páez
9 months ago

Great post! Really helped me understand how to use built-in skills for document processing.

Andrijana Zdravković

Can anyone explain how to use the Entity Recognition skill in more detail?

Salvador Sáez
7 months ago

How important is the Sentiment Analysis skill for the exam?

Enver Anton
11 months ago

Thanks! This was really useful.

Gustav Sørensen
6 months ago

I think the OCR skill integration could have been explained better.

Teodoro Zamora
10 months ago

Loved the detailed steps provided. Thank you!

Julia Mitchell
6 months ago

Does anyone know if there’s a way to combine multiple built-in skills for a single document?

Johan Christensen
11 months ago

Appreciate the post. Good for beginners!

27
0
Would love your thoughts, please comment.x
()
x