Monitor and analyze jobs in studio

You can use Azure Machine Learning studio to monitor, organize, and track your jobs for training and experimentation. Your machine learning (ML) job history is an important part of an explainable and repeatable ML development process.

This article explains how to:

• Add a job display name.
• Create a custom view.
• Add a job description.
• Tag and find jobs.
• Run search over your job history.
• Cancel or fail jobs.
• Monitor job status by email notification.
• Monitor your job resources (preview).

Prerequisites

You need the following items:

• To use Azure Machine Learning, you must have an Azure subscription. If you don't have an Azure subscription, create a free account before you begin. Try the free or paid version of Azure Machine Learning.
• You must have an Azure Machine Learning workspace. A workspace is created in Install, set up, and use the CLI (v2).

Job display name

The job display name is an optional and customizable name that you can provide for your job. To edit the job display name:

1. Navigate to the Jobs list.

2. Select the job to edit.

   

3. Select the Edit button to edit the job display name.

   

Custom view

To view your jobs in the studio:

1. Navigate to the Jobs tab.

2. Select either All experiments to view all the jobs in an experiment, or select All jobs to view all the jobs submitted in the Workspace.

On the All jobs page, you can filter the jobs list by tags, experiments, compute target, and more to better organize and scope your work.

1. Make customizations to the page by selecting jobs to compare, adding charts, or applying filters. These changes can be saved as a Custom view so you can easily return to your work. Users with workspace permissions can edit or view the custom view. Also, share the custom view with team members for enhanced collaboration by selecting Share view.

   

2. To view the job logs, select a specific job and in the Outputs + logs tab, you can find diagnostic and error logs for your job.

Job description

You can add a job description to provide more context and information to the job. You can also search on these descriptions from the jobs list and add the job description as a column in the jobs list.

Navigate to the details page for your job and select the edit or pencil icon to add, edit, or delete descriptions for your job. To persist the changes to the jobs list, save the changes to your existing custom view or a new custom view. Markdown format is supported for job descriptions, which allows images to be embedded and deep linking as shown.

Tag and find jobs

In Azure Machine Learning, you can use properties and tags to help organize and query your jobs for important information.

Edit tags

You can add, edit, or delete job tags from the studio. Navigate to the details page for your job and select the edit or pencil icon to add, edit, or delete tags for your jobs. You can also search and filter on these tags from the jobs list page.

Query properties and tags

You can query jobs within an experiment to return a list of jobs that match specific properties and tags.

To search for specific jobs, navigate to the All jobs list. From there, you have two options:

• Use the Add filter button and select filter on tags to filter your jobs by tag that was assigned to the job(s).
• Use the search bar to quickly find jobs by searching on the job metadata like job status, descriptions, experiment names, and submitter name.

Cancel or fail jobs

If you notice a mistake or if your job is taking too long to finish, you can cancel the job.

To cancel a job in the studio:

1. Go to the running pipeline in either the Jobs or Pipelines section.

2. Select the pipeline job number you want to cancel.

3. In the toolbar, select Cancel.

Monitor job status by email notification

1. In the Azure portal, in the left navigation bar, select the Monitor tab.

2. Select Diagnostic settings, then choose + Add diagnostic setting.

   

3. Under Category details, select AmlRunStatusChangedEvent. Under Destination details, select Send to Log Analytics workspace and specify the Subscription and Log Analytics workspace.

   

   Note

   The Azure Log Analytics Workspace is a different type of Azure resource than the Azure Machine Learning service workspace. If there are no options in that list, you can create a Log Analytics workspace.

4. In the Logs tab, select New alert rule.

   

5. To learn how to create and manage log alerts using Azure Monitor, see Create or edit a log search alert rule.

Related content

• Log metrics, parameters, and files with MLflow
• Monitor Azure Machine Learning