Edit

Share via

Deploy an Azure Operator Insights Data Product

  • Article

In this article, you learn how to create an Azure Operator Insights Data Product instance.

Note

Access is currently only available by request. More information is included in the application form. We appreciate your patience as we work to enable broader access to Azure Operator Insights Data Product. Apply for access by filling out this form.

Prerequisites

  • An Azure subscription for which the user account must be assigned the Contributor role. If needed, create a free subscription before you begin.
  • Access granted to Azure Operator Insights for the subscription. Apply for access by completing this form.
  • (Optional) If you plan to integrate Data Product with Microsoft Purview, you must have an active Purview account. Make note of the Purview collection ID when you set up Microsoft Purview with a Data Product.
  • After obtaining your subscription access, register the Microsoft.NetworkAnalytics and Microsoft.HybridNetwork Resource Providers (RPs) to continue. For guidance on registering RPs in your subscription, see Register resource providers in Azure.

Prepare your Azure portal or Azure CLI environment

You can use the Azure portal or the Azure CLI to follow the steps in this article.

Confirm that you can sign in to the Azure portal and can access the subscription.

Create a resource group

A resource group is a logical container into which Azure resources are deployed and managed.

If you plan to use CMK-based data encryption or Microsoft Purview, set up a resource group now:

  1. Sign in to the Azure portal.
  2. Select Resource groups.
  3. Select Create and follow the prompts.

For more information, see Create resource groups.

If you don't plan to use CMK-based date encryption or Microsoft Purview, you can set up a resource group now or when you create the Data Product resource.

Set up resources for CMK-based data encryption or Microsoft Purview

If you plan to use CMK-based data encryption or Microsoft Purview, you must set up an Azure Key Vault instance and a user-assigned managed identity (UAMI) first.

Set up a key in an Azure Key Vault

An Azure Key Vault instance stores your Customer Managed Key (CMK) for data encryption. The Data Product uses this key to encrypt your data over and above the standard storage encryption. You need to have Subscription/Resource group owner permissions to perform this step.

  1. Create an Azure Key Vault resource in the same subscription and resource group that you set up in Create a resource group.
  2. Provide your user account with the Key Vault Administrator role on the Azure Key Vault resource. This is done via the Access Control (IAM) tab on the Azure Key Vault resource.
  3. Navigate to the object and select Keys. Select Generate/Import.
  4. Enter a name for the key and select Create.
  5. Select the newly created key and select the current version of the key.
  6. Copy the Key Identifier URI to your clipboard to use when creating the Data Product.

Set up a user-assigned managed identity

  1. Create a user-assigned managed identity using Microsoft Entra ID for CMK-based encryption. The Data Product also uses the user-assigned managed identity (UAMI) to interact with the Microsoft Purview account.
  2. Navigate to the Azure Key Vault resource that you created earlier and assign the UAMI with Key Vault Administrator role.

Create an Azure Operator Insights Data Product resource

You create the Azure Operator Insights Data Product resource.

  1. Sign in to the Azure portal.

  2. In the search bar, search for Operator Insights and select Azure Operator Insights - Data Products.

  3. On the Azure Operator Insights - Data Products page, select Create.

  4. On the Basics tab of the Create a Data Product page:

    1. Select your subscription.
    2. Select the resource group you previously created for the Key Vault resource.
    3. Under Instance details, complete the following fields:
      • Name - Enter the name for your Data Product resource. The name must start with a lowercase letter and can contain only lowercase letters and numbers.
      • Publisher - Select the organization that created and published the Data Product that you want to deploy.
      • Product - Select the name of the Data Product.
      • Version - Select the version.

    Select Next: Advanced.

    Screenshot of the Instance details section of the Basics configuration for a Data Product in the Azure portal.

  5. In the Advanced tab of the Create a Data Product page:

    1. Enable Purview if you're integrating with Microsoft Purview. Select the subscription for your Purview account, select your Purview account, and enter the Purview collection ID.
    2. Enable Customer managed key if you're using CMK for data encryption.
    3. Select the user-assigned managed identity that you set up as a prerequisite.
    4. Carefully paste the Key Identifier URI that was created when you set up Azure Key Vault as a prerequisite.

  6. To add one or more owners for the Data Product, which will also appear in Microsoft Purview, select Add owner, enter the email address, and select Add owners.

  7. In the Tags tab of the Create a Data Product page, select or enter the name/value pair used to categorize your Data Product resource.

  8. Select Review + create.

  9. Select Create. Your Data Product instance is created in about 20-25 minutes. During this time, all the underlying components are provisioned. After this process completes, you can work with your data ingestion, explore sample dashboards and queries, and so on.

Deploy sample insights

Once your Data Product instance is created, you can deploy a sample insights dashboard. This dashboard works with the sample data that came along with the Data Product instance.

  1. Navigate to your Data Product resource on the Azure portal and select the Permissions tab on the Security section.
  2. Select Add Reader. Type the user's email address to be added to Data Product reader role.

Note

The reader role is required for you to have access to the insights consumption URL.

  1. Download the sample JSON template file for your Data Product's dashboard:
  2. Copy the consumption URL from the Data Product overview screen into the clipboard.
  3. Open a web browser, paste in the URL and select enter.
  4. When the URL loads, select on the Dashboards option on the left navigation pane.
  5. Select the New Dashboard drop down and select Import dashboard from file. Browse to select the JSON file downloaded previously, provide a name for the dashboard, and select Create.
  6. Select the three dots (...) at the top right corner of the consumption URL page and select Data Sources.
  7. Select the pencil icon next to the Data source name to edit the data source.
  8. Under the Cluster URI section, replace the URL with your Data Product consumption URL and select connect.
  9. In the Database drop-down, select your Database. Typically, the database name is the same as your Data Product instance name. Select Apply.

Note

These dashboards are based on synthetic data and may not have complete or representative examples of the real-world experience.

Explore sample data using Kusto

The consumption URL also allows you to write your own Kusto query to get insights from the data.

  1. On the Overview page, copy the consumption URL and paste it in a new browser tab to see the database and list of tables.

    Screenshot of part of the Overview pane in the Azure portal, showing the consumption URL.

  2. Use the ADX query plane to write Kusto queries.

    • For Quality of Experience - Affirmed MCC GIGW, try the following queries:

      enriched_flow_events_sample
| summarize Application_count=count() by flowRecord_dpiStringInfo_application
| order by Application_count desc
| take 10

      enriched_flow_events_sample
| summarize SumDLOctets = sum(flowRecord_dataStats_downLinkOctets) by bin(eventTimeFlow, 1h)
| render columnchart

    • For Monitoring - Affirmed MCC Data Product, try the following queries:

      SYSTEMCPUSTATISTICSCORELEVEL_SAMPLE
| where systemCpuStats_core >= 25 and systemCpuStats_core <= 36
| summarize p90ssm_avg_1_min_cpu_util=round(percentile(ssm_avg_1_min_cpu_util, 90), 2) by resourceId

      PGWCALLPERFSTATSGRID_SAMPLE
| summarize clusterTotal=max(NumUniqueSubscribers) by bin(timestamp, 1d)
| render linechart

Optionally, delete Azure resources

If you're using this Data Product to explore Azure Operator Insights, you should delete the resources you've created to avoid unnecessary Azure costs.

  1. On the Home page of the Azure portal, select Resource groups.
  2. Select the resource group for your Azure Operator Insights Data Product and verify that it contains the Azure Operator Insights Data Product instance.
  3. At the top of the Overview page for your resource group, select Delete resource group.
  4. Enter the resource group name to confirm the deletion, and select Delete.

Next step

Upload data to your Data Product:

  1. Read the documentation for your Data Product to determine any requirements for ingestion.
  2. Set up an ingestion solution: