AI-102T00a
AI-102T00a
AI-102T00a
Introduction
AI-102 Designing and Implementing an Azure AI Solution is intended for software developers wanting to build AI
infused applications that leverage Azure AI Services, Azure AI Search, and Azure OpenAI. The course will use C# or
Python as the programming language.
Audience
Software engineers concerned with building, managing and deploying AI solutions that leverage Azure AI Services,
Azure AI Search, and Azure OpenAI. They are familiar with C# or Python and have knowledge on using REST-based
APIs to build computer vision, language analysis, knowledge mining, intelligent search, and generative AI solutions on
Azure.
Prerequisites
Before attending this course, students must have:
• Knowledge of Microsoft Azure and ability to navigate the Azure portal
• Knowledge of either C# or Python
• Familiarity with JSON and REST programming semantics
To gain C# or Python skills, complete the free Take your first steps with C# or Take your first steps with
Python learning path before attending the course.
If you are new to artificial intelligence, and want an overview of AI capabilities on Azure, consider completing
the Azure AI Fundamentals certification before taking this one.
Course Outline
Module 1: Get started with Azure AI Services
Azure AI Services is a collection of services that are building blocks of AI functionality you can integrate into your
applications. In this learning path, you'll learn how to provision, secure, monitor, and deploy Azure AI Services
resources and use them to build intelligent solutions.
Lessons
• Define artificial intelligence
• Understand AI-related terms
• Understand considerations for AI Engineers
• Understand considerations for responsible AI
• Understand capabilities of Azure Machine Learning
• Understand capabilities of Azure Cognitive Services
• Understand capabilities of the Azure Bot Service
• Understand capabilities of Azure Cognitive Search
Lessons
• Provision an Azure AI services resource
• Identify endpoints and keys
• Use a REST API
• Use an SDK
• Exercise - Use Azure AI services
Lessons
• Consider authentication
• Implement network security
• Exercise - Manage Cognitive Services Security
Lessons
• Monitor cost
• Create alerts
• View metrics
• Manage diagnostic logging
• Exercise - Monitor Azure AI services
Lessons
• Introduction
• Understand containers
• Use Azure AI services containers
• Exercise - Use a container
Lessons
• Introduction
• Provision an Azure AI Vision resource
• Analyze an image
• Generate a smart-cropped thumbnail and remove background
Copyright © KENFIL HONG KONG LIMITED Course Outline
Course AI-102T00: Designing and Implementing a Microsoft Azure AI Solution Page 3 of 9
Lessons
• Understand custom model types
• Create a custom project
• Label and train a custom model
• Exercise - Classify images with an Azure AI Vision custom model
Lessons
• Identify options for face detection analysis and identification
• Understand considerations for face analysis
• Detect faces with the Azure AI Vision service
• Understand capabilities of the face service
• Compare and match detected faces
• Implement facial recognition
• Exercise - Detect, analyze, and identify faces
Module 2-4: Read Text in images and documents with the Azure AI Vision Service
Azure's AI Vision service uses algorithms to process images and return information. This module teaches you how to
use the Image Analysis API for optical character recognition (OCR).
Lessons
• Explore Azure AI Vision options for reading text
• Use the Read API
• Exercise - Read text in images
Lessons
• Understand Azure Video Indexer capabilities
• Extract custom insights
• Use Video Analyzer widgets and APIs
• Exercise - Analyze video
Lessons
• Provision an Azure AI Language resource
• Detect language
Lessons
• Understand question answering
• Compare question answering to Azure AI Language understanding
• Create a knowledge base
• Implement multi-turn conversation
• Test and publish a knowledge base
• Use a knowledge base
• Improve question answering performance
• Exercise - Create a question answering solution
Lessons
• Understand prebuilt capabilities of the Azure AI Language service
• Understand resources for building a conversational language understanding model
• Define intents, utterances, and entities
• Use patterns to differentiate similar utterances
• Use pre-built entity components
• Train, test, publish, and review a conversational language understanding model
• Exercise - Build an Azure AI services conversational language understanding model
Lessons
• Understand types of classification projects
• Understand how to build text classification projects
• Exercise - Classify text
Lessons
• Understand custom named entity recognition
• Label your data
• Train and evaluate your model
• Exercise - Extract custom entities
Lessons
• Provision an Azure AI Translator resource
Copyright © KENFIL HONG KONG LIMITED Course Outline
Course AI-102T00: Designing and Implementing a Microsoft Azure AI Solution Page 5 of 9
Lessons
• Provision an Azure AI Translator resource
• Understand language detection, translation, and transliteration
• Specify translation options
• Define custom translations
• Exercise - Translate text with the Azure AI Translator service
Lessons
• Provision an Azure resource for speech translation
• Translate speech to text
• Synthesize translations
• Exercise - Translate speech
Lessons
• Manage capacity
• Understand search components
• Understand the indexing process
• Search an index
• Apply filtering and sorting
• Enhance the index
• Exercise - Create a search solution
Lessons
• Create a custom skill
• Add a custom skill to a skillset
• Exercise - Implement a custom skill
Lessons
• Define projections
• Define a knowledge store
• Exercise - Create a knowledge store
Lessons
• Explore the available features of Azure AI Language
• Enrich a search index in Azure AI Search with custom classes and Azure AI Language
• Exercise: Enrich a search index in Azure AI Search with custom classes
Lessons
• Improve the ranking of a document with term boosting
• Improve the relevance of results by adding scoring profiles
• Improve an index with analyzers and tokenized terms
• Enhance an index to include multiple languages
• Improve search experience by ordering results by distance from a given reference point
• Exercise: Implement enhancements to search results
Module 4-6: Build an Azure Machine Learning custom skill for Azure AI Search
Custom skills allow you to enhance datasets as they pass through the enrichment pipeline. Azure Machine Learning
can build custom models for regression or classification to enrich your search indexes.
Lessons
• Understand how to use a custom Azure Machine Learning skillset
• Enrich a search index using an Azure Machine Learning model
• Exercise: Enrich a search index using Azure Machine Learning model
Module 4-7: Search data outside the Azure platform in Azure AI Search using Azure Data Factory
Use Azure Data Factory to add data that resides inside or outside the Azure platform into your search indexes.
Lessons
• Index data from external data sources using Azure Data Factory
• Index any data using the Azure AI Search push API
• Exercise: Add to an index using the push API
Lessons
• Manage security of an Azure AI Search solution
• Optimize performance of an Azure AI Search solution
• Manage costs of an Azure AI Search solution
• Improve reliability of an Azure AI Search solution
• Monitor an Azure AI Search solution
Module 4-9: Perform search re-ranking with semantic ranking in Azure AI Search
Learn how to perform L2 ranking with semantic ranker in Azure AI Search.
Lessons
• What is semantic ranking?
• Set up semantic ranking
• Exercise - Use semantic ranking on an index
Lessons
• What is vector search?
• Prepare your search
• Understand embedding
• Exercise - Use the REST API to run vector search queries
Lessons
• Understand AI Document Intelligence
• Plan Azure AI Document Intelligence resources
• Choose a model type
Lessons
• Understand prebuilt models
• Use the General Document, Read, and Layout models
• Use financial, ID, and tax models
• Exercise - Analyze a document using Azure AI Document Intelligence
Module 5-3: Extract data from forms with Azure Document Intelligence
Document intelligence uses machine learning technology to identify and extract key-value pairs and table data from
form documents with accuracy, at scale. This module teaches you how to use the Azure Document intelligence
cognitive service.
Lessons
• What is Azure Document Intelligence?
Lessons
• Understand composed models
• Assemble composed models
• Exercise: Create a composed model
Module 5-5: Build a Document intelligence custom skill for Azure AI search
Learn how to use an Azure Document Intelligence solution as a custom skill to enrich content in an Azure AI Search
pipeline.
Lessons
• Understand Azure AI Search enrichment pipelines
• Build an Azure AI Document Intelligence custom skill
• Exercise: Build and deploy an Azure AI Document Intelligence custom skill
Lessons
• Access Azure OpenAI Service
• Use Azure AI Studio
• Explore types of generative AI models
• Deploy generative AI models
• Use prompts to get completions from models
• Test models in Azure AI Studio's playground
• Exercise - Get started with Azure OpenAI Service
Module 6-2: Build natural language solutions with Azure OpenAI Service
This module provides engineers with the skills to begin building apps that integrate with the Azure OpenAI Service.
Lessons
• Integrate Azure OpenAI into your app
• Use Azure OpenAI REST API
• Use Azure OpenAI SDK
• Exercise - Integrate Azure OpenAI into your app
Lessons
• Understand prompt engineering
• Write more effective prompts
• Provide context to improve accuracy
• Exercise - Utilize prompt engineering in your application
Lessons
• Construct code from natural language
• Complete code and assist the development process
• Fix bugs and improve your code
• Exercise - Generate and improve code with Azure OpenAI Service
Lessons
• What is DALL-E?
• Explore DALL-E in Azure OpenAI Studio
• Use the Azure OpenAI REST API to consume DALL-E models
• Exercise - Generate images with a DALL-E model
Module 6-6: Implement Retrieval Augmented Generation (RAG) with Azure OpenAI Service
Use the Azure OpenAI on your data allows developers to implement RAG with supported AI chat models to reference
specific sources of data to ground the response.
Lessons
• Understand Retrieval Augmented Generation (RAG) with Azure OpenAI Service
• Add your own data source
• Chat with your model using your own data
• Exercise - Add your data for RAG with Azure OpenAI Service
Lessons
• Plan a responsible generative AI solution
• Identify potential harms
• Measure potential harms
• Mitigate potential harms
• Operate a responsible generative AI solution
• Exercise - Explore content filters in Azure OpenAI