What are Azure AI services?
Azure AI services help developers and organizations rapidly create intelligent, cutting-edge, market-ready, and responsible applications with out-of-the-box and prebuilt and customizable APIs and models. Example applications include natural language processing for conversations, search, monitoring, translation, speech, vision, and decision-making.
Tip
Try Azure AI services including Azure OpenAI, Content Safety, Speech, Vision, and more in Azure AI Studio. For more information, see What is Azure AI Studio?.
Most Azure AI services are available through REST APIs and client library SDKs in popular development languages. For more information, see each service's documentation.
Available Azure AI services
Learn how an Azure AI service can help your enhance applications and optimize your workflows:
Service | Description |
---|---|
Anomaly Detector (retired) | Identify potential problems early on. |
Azure AI Search | Bring AI-powered cloud search to your mobile and web apps. |
Azure OpenAI | Perform a wide variety of natural language tasks. |
Bot Service | Create bots and connect them across channels. |
Content Moderator (retired) | Detect potentially offensive or unwanted content. |
Content Safety | An AI service that detects unwanted contents. |
Custom Vision | Customize image recognition for your business. |
Document Intelligence | Turn documents into intelligent data-driven solutions. |
Face | Detect and identify people and emotions in images. |
Immersive Reader | Help users read and comprehend text. |
Language | Build apps with industry-leading natural language understanding capabilities. |
Language understanding (retired) | Understand natural language in your apps. |
Metrics Advisor (retired) | An AI service that detects unwanted contents. |
Personalizer (retired) | Create rich, personalized experiences for each user. |
QnA maker (retired) | Distill information into easy-to-navigate questions and answers. |
Speech | Speech to text, text to speech, translation, and speaker recognition. |
Translator | Use AI-powered translation technology to translate more than 100 in-use, at-risk, and endangered languages and dialects. |
Video Indexer | Extract actionable insights from your videos. |
Vision | Analyze content in images and videos. |
Pricing tiers and billing
Pricing tiers (and the amount you get billed) are based on the number of transactions you send using your authentication information. Each pricing tier specifies the:
- Maximum number of allowed transactions per second (TPS).
- Service features enabled within the pricing tier.
- Cost for a predefined number of transactions. Going above this number causes an extra charge as specified in the pricing details for your service.
Note
Many of the Azure AI services have a free tier you can use to try the service. To use the free tier, use F0
as the SKU for your resource.
Development options
The tools that you can use to customize and configure models are different from tools that you use to call the Azure AI services. Out of the box, most Azure AI services allow you to send data and receive insights without any customization. For example:
- You can send an image to the Azure AI Vision service to detect words and phrases or count the number of people in the frame
- You can send an audio file to the Speech service and get transcriptions and translate the speech to text at the same time
Azure offers a wide range of tools that are designed for different types of users, many of which can be used with Azure AI services. Designer-driven tools are the easiest to use, and are quick to set up and automate, but might have limitations when it comes to customization. Our REST APIs and client libraries provide users with more control and flexibility, but require more effort, time, and expertise to build a solution. If you use REST APIs and client libraries, there's an expectation that you're comfortable working with modern programming languages like C#, Java, Python, JavaScript, or another popular programming language.
Let's take a look at the different ways that you can work with the Azure AI services.
Client libraries and REST APIs
Azure AI services client libraries and REST APIs provide direct access to your service. These tools provide programmatic access to the Azure AI services, their baseline models, and in many cases allow you to programmatically customize your models and solutions.
- Target user(s): Developers and data scientists
- Benefits: Provides the greatest flexibility to call the services from any language and environment
- UI: N/A - Code only
- Subscription(s): Azure account + Azure AI services resources
If you want to learn more about available client libraries and REST APIs, use our Azure AI services overview to pick a service and get started with one of our quickstarts.
Continuous integration and deployment
You can use Azure DevOps and GitHub Actions to manage your deployments. In the following section, we have two examples of CI/CD integrations to train and deploy custom models for Speech and the Language Understanding (LUIS) service.
- Target user(s): Developers, data scientists, and data engineers
- Benefits: Allows you to continuously adjust, update, and deploy applications and models programmatically. There's significant benefit when regularly using your data to improve and update models for Speech, Vision, Language, and Decision
- UI tools: N/A - Code only
- Subscription(s): Azure account + Azure AI services resource + GitHub account
Continuous integration and delivery with DevOps and GitHub Actions
Language Understanding and the Speech service offer continuous integration and continuous deployment solutions that are powered by Azure DevOps and GitHub Actions. These tools are used for automated training, testing, and release management of custom models.
On-premises containers
Many of the Azure AI services can be deployed in containers for on-premises access and use. Using these containers gives you the flexibility to bring Azure AI services closer to your data for compliance, security, or other operational reasons. For a complete list of Azure AI containers, see On-premises containers for Azure AI services.
Training models
Some services allow you to bring your own data, then train a model. Trained custom models allow you to extend the model using the service's data and algorithm with your own data. The output matches your needs. When you bring your own data, you might need to tag the data in a way specific to the service. For example, if you're training a model to identify flowers, you can provide a catalog of flower images along with the location of the flower in each image to train the model.
Azure AI services in the ecosystem
With Azure and Azure AI services, you have access to a broad ecosystem, such as:
- Automation and integration tools like Logic Apps and Power Automate.
- Deployment options such as Azure Functions and the App Service.
- Azure AI services Docker containers for secure access.
- Tools like Apache Spark, Azure Databricks, Azure Synapse Analytics, and Azure Kubernetes Service for big data scenarios.
To learn more, see Azure AI services ecosystem.
Regional availability
The APIs in Azure AI services are hosted on a growing network of Microsoft-managed data centers. You can find the regional availability for each API in Azure region list.
Looking for a region we don't support yet? Let us know by filing a feature request on our UserVoice forum.
Language support
Azure AI services support a wide range of cultural languages at the service level. You can find the language availability for each API in the supported languages list.
Security
Azure AI services provide a layered security model, including authentication with Microsoft Entra credentials, a valid resource key, and Azure Virtual Networks.
Certifications and compliance
Azure AI services awarded certifications include Cloud Security Alliance STAR Certification, FedRAMP Moderate, and HIPAA BAA.
To understand privacy and data management, go to the Trust Center.
Help and support
Azure AI services provide several support options to help you move forward with creating intelligent applications. Azure AI services also have a strong community of developers that can help answer your specific questions. For a full list of support options available to you, see Azure AI services support and help options.
Next steps
Feedback
https://aka.ms/ContentUserFeedback.
Coming soon: Throughout 2024 we will be phasing out GitHub Issues as the feedback mechanism for content and replacing it with a new feedback system. For more information see:Submit and view feedback for