Manually configure your CI/CD workflow for running load tests

• An Azure DevOps organization and project. If you don't have an Azure DevOps organization, you can create one for free. If you need help with getting started with Azure Pipelines, see Create your first pipeline.

• A GitHub account. If you don't have a GitHub account, you can create one for free.
• A GitHub repository to store the load test input files and create a GitHub Actions workflow. To create one, see Creating a new repository.

• Permission to create or modify a CI pipeline.
• A source code repository to store the load test input files.

Create a service connection in Azure Pipelines

In Azure Pipelines, you create a service connection in your Azure DevOps project to access resources in your Azure subscription. When you create the service connection, Azure DevOps creates a Microsoft Entra service principal object.

1. Sign in to your Azure DevOps organization (https://dev.azure.com/<your-organization>), and select your project.

   Replace the <your-organization> text placeholder with your project identifier.

2. Select Project settings > Service connections > + New service connection.

3. In the New service connection pane, select the Azure Resource Manager, and then select Next.

4. Select the Service Principal (automatic) authentication method, and then select Next.

5. Enter the service connection details, and then select Save to create the service connection.

   Field	Value
   Scope level	Subscription.
   Subscription	Select the Azure subscription that hosts your load testing resource.
   Resource group	Select the resource group that contains your load testing resource.
   Service connection name	Enter a unique name for the service connection.
   Grant access permission to all pipelines	Checked.

6. From the list of service connections, select the one you created earlier, and then select Manage Service Principal.

   

   The Azure portal opens in a separate browser tab and shows the service principal details.

7. In the Azure portal, copy the Display name value.

   You use this value in the next step to grant permissions for running load tests to the service principal.

Grant access to Azure Load Testing

Azure Load Testing uses Azure RBAC to grant permissions for performing specific activities on your load testing resource. To run a load test from your CI/CD pipeline, you grant the Load Test Contributor role to the service principal.

1. In the Azure portal, go to your Azure Load Testing resource.

2. Select Access control (IAM) > Add > Add role assignment.

3. In the Role tab, select Load Test Contributor in the list of job function roles.

   

4. In the Members tab, select Select members, and then use the display name you copied previously to search the service principal.

5. Select the service principal, and then select Select.

6. In the Review + assign tab, select Review + assign to add the role assignment.

You can now use the service connection in your Azure Pipelines workflow definition to access your Azure load testing resource.

To access your Azure Load Testing resource from the GitHub Actions workflow, you first create a Microsoft Entra service principal. This service principal represents your GitHub Actions workflow in Microsoft Entra ID.

Next, you grant permissions to the service principal to create and run a load test with your Azure Load Testing resource.

Create a service principal

Create a service principal in the Azure subscription and assign the Load Test Contributor role so that your GitHub Actions workflow has access to your Azure load testing resource to run load tests.

1. Create a service principal and assign the Load Test Contributor role:

   # Get the resource ID for the load testing resource - replace the text place holders.
   loadtest=$(az resource show -g <resource-group-name> -n <load-testing-resource-name> --resource-type "Microsoft.LoadTestService/loadtests" --query "id" -o tsv)
   echo $loadtest
   
   # Create a service principal and assign the Load Test Contributor role - the scope is limited to the load testing resource.
   az ad sp create-for-rbac --name "my-load-test-cicd" --role "Load Test Contributor" \
                            --scopes $loadtest \
                            --json-auth
   

   The output is a JSON object that represents the service principal. You use this information to authenticate with Azure in the GitHub Actions workflow.

   Creating 'Load Test Contributor' role assignment under scope
   {
     "clientId": "00000000-0000-0000-0000-000000000000",
     "clientSecret": "00000000-0000-0000-0000-000000000000",
     "subscriptionId": "00000000-0000-0000-0000-000000000000",
     "tenantId": "00000000-0000-0000-0000-000000000000",
     "activeDirectoryEndpointUrl": "https://login.microsoftonline.com",
     "resourceManagerEndpointUrl": "https://management.azure.com/",
     "activeDirectoryGraphResourceId": "https://graph.windows.net/",
     "sqlManagementEndpointUrl": "https://management.core.windows.net:8443/",
     "galleryEndpointUrl": "https://gallery.azure.com/",
     "managementEndpointUrl": "https://management.core.windows.net/"    
   }
   

   Note

   You might get a --sdk-auth deprecation warning when you run this command. Alternatively, you can use OpenID Connect (OIDC) based authentication for authenticating GitHub with Azure. Learn how to use the Azure login action with OpenID Connect.

2. Copy the output JSON object to the clipboard.

   In the next step, you store the service principal information as a GitHub Actions secret.

Store Azure credentials in GitHub Actions secret

Create a GitHub Actions secret to securely store the service principal information. You use this secret in your workflow definition to connect to authenticate with Azure and access your Azure load testing resource.

To create a GitHub Actions secret:

1. In GitHub, browse to your repository.

2. Select Settings > Secrets & variables > Actions.

3. Select New repository secret, enter the secret information, and then select Add secret to create a new secret.

   Field	Value
   Name	AZURE_CREDENTIALS
   Secret	Paste the JSON output from the service principal creation command you copied earlier.

You can now access your Azure subscription and load testing resource from your GitHub Actions workflow by using the stored credentials.

If you're using another CI/CD tool, you use the Azure CLI to interact with your Azure resources. Perform the following steps to authorize the CI tool access to your load testing resource:

1. Create a Microsoft Entra service principal to connect to your Azure subscription and access your Azure load testing resource.
2. Grant the service principal permissions to create and run a load test by assigning the Load Test Contributor role.
3. Store the Azure credentials securely in the CI tool.

Perform the following steps to configure the service authorization for your CI tool:

1. Create a service principal and assign the Load Test Contributor role:

   Replace the <resource-group-name> and <load-testing-resource-name> text placeholders.

   # Get the resource ID for the load testing resource - replace the text place holders.
   loadtest=$(az resource show -g <resource-group-name> -n <load-testing-resource-name> --resource-type "Microsoft.LoadTestService/loadtests" --query "id" -o tsv)
   echo $loadtest
   
   # Create a service principal and assign the Load Test Contributor role - the scope is limited to the load testing resource.
   az ad sp create-for-rbac --name "my-load-test-cicd" --role "Load Test Contributor" \
                            --scopes $loadtest \
                            --json-auth
   

   The output is a JSON object that represents the service principal.

   Creating 'Load Test Contributor' role assignment under scope
   {
     "clientId": "00000000-0000-0000-0000-000000000000",
     "clientSecret": "00000000-0000-0000-0000-000000000000",
     "subscriptionId": "00000000-0000-0000-0000-000000000000",
     "tenantId": "00000000-0000-0000-0000-000000000000",
     "activeDirectoryEndpointUrl": "https://login.microsoftonline.com",
     "resourceManagerEndpointUrl": "https://management.azure.com/",
     "activeDirectoryGraphResourceId": "https://graph.windows.net/",
     "sqlManagementEndpointUrl": "https://management.core.windows.net:8443/",
     "galleryEndpointUrl": "https://gallery.azure.com/",
     "managementEndpointUrl": "https://management.core.windows.net/"    
   }
   

2. Copy the clientId, clientSecret, and tenantId values and securely store them as secrets in your CI tool.

   You use these values to sign into your Azure subscription with the Azure CLI az login command.

Install the Azure Load Testing extension for Azure DevOps

To create and run a load test, the Azure Pipelines workflow definition uses the Azure Load Testing task extension from the Azure DevOps Marketplace.

1. Open the Azure Load Testing task extension in the Azure DevOps Marketplace, and select Get it free.

2. Select your Azure DevOps organization, and then select Install to install the extension.

   If you don't have administrator privileges for the selected Azure DevOps organization, select Request to request an administrator to install the extension.

Update the Azure Pipelines workflow

Update your Azure Pipelines workflow to run a load test for your Azure load testing resource.

1. Sign in to your Azure DevOps organization (https://dev.azure.com/<your-organization>), and select your project.

2. Select Pipelines in the left navigation, select your pipeline, and then select Edit to edit your workflow definition.

   Alternately, select Create Pipeline to create a new pipeline in Azure Pipelines.

3. Use the AzureLoadTest task to run the load test.

   Specify the load test configuration file you exported earlier in the loadTestConfigFile property.

   Replace the <load-testing-resource> and <load-testing-resource-group> text placeholders with the name of your Azure load testing resource and the resource group.

       - task: AzureLoadTest@1
         inputs:
           azureSubscription: $(serviceConnection)
           loadTestConfigFile: 'config.yaml'
           loadTestResource: <load-testing-resource>
           resourceGroup: <load-testing-resource-group>
   

   Optionally, you can pass parameters or secrets to the load test by using the env or secrets property.

4. Use the publish task to publish the test results as artifacts in your Azure Pipelines workflow run.

       - publish: $(System.DefaultWorkingDirectory)/loadTest
         artifact: loadTestResults
   

Update the GitHub Actions workflow

Update your GitHub Actions workflow to run a load test for your Azure load testing resource.

1. In GitHub, browse to your repository.

2. Edit your GitHub Actions workflow or create a new workflow in your GitHub repository.

3. Use the actions/checkout action to check out the repository with the load test input files.

       - name: Checkout
         uses: actions/checkout@v3
   

4. Use the azure/login action to authenticate with Azure by using the stored credentials.

   Paste the following YAML contents in your workflow definition:

       - name: Login to Azure
         uses: azure/login@v1
         continue-on-error: false
         with:
           creds: ${{ secrets.AZURE_CREDENTIALS }}
   

5. Use the azure/load-testing action to run the load test.

   Specify the load test configuration file you exported earlier in the loadTestConfigFile property.

   Replace the <load-testing-resource> and <load-testing-resource-group> text placeholders with the name of your Azure load testing resource and the resource group.

       - name: 'Azure Load Testing'
         uses: azure/load-testing@v1
         with:
           loadTestConfigFile: 'config.yaml'
           loadTestResource: <load-testing-resource>
           resourceGroup: <load-testing-resource-group>
   

   Optionally, you can pass parameters or secrets to the load test by using the env or secrets property.

6. Use the actions/upload-artifact action to publish the test results as artifacts in your GitHub Actions workflow run.

       - uses: actions/upload-artifact@v2
         with:
           name: loadTestResults
           path: ${{ github.workspace }}/loadTest
   

Update your CI workflow to run a load test for your Azure load testing resource by using the Azure CLI. Use the specifics of your CI tool to add the following commands to your CI workflow:

1. Sign into the Azure subscription by using the service principal.

   Use the clientId, clientSecret, and tenandId values you stored previously.

   az login --service-principal -u $AZURE_CLIENT_ID -p $AZURE_CLIENT_SECRET -t $AZURE_TENANT_ID
   az account set -s $AZURE_SUBSCRIPTION_ID
   

2. Create a load test by using the load test configuration YAML file.

   Replace the <load-testing-resource>, <load-testing-resource-group>, and <load-test-config-yaml> text placeholders with the name of the load testing resource, the resource group name, and the file name of the load test configuration YAML file you added to the repository previously.

   az load test create --load-test-resource <load-testing-resource> --resource-group <load-testing-resource-group> --test-id sample-test-id --load-test-config-file <load-test-config-yaml>
   

3. Run the load test.

   testRunId="run_"`date +"%Y%m%d%_H%M%S"`
   displayName="Run"`date +"%Y/%m/%d_%H:%M:%S"`
   
   az load test-run create --load-test-resource <load-testing-resource> --test-id sample-test-id --test-run-id $testRunId --display-name $displayName --description "Test run from CLI"
   

4. Retrieve and display the client-side metrics for the load test run.

   az load test-run metrics list --load-test-resource <load-testing-resource> --test-run-id $testRunId --metric-namespace LoadTestRunMetrics
   

1. Remove Azure Pipelines changes:

   1. Sign in to your Azure DevOps organization (https://dev.azure.com/<your-organization>), and select your project.

      Replace the <your-organization> text placeholder with your project identifier.

   2. If you created a new pipeline":

      1. Select Pipelines, and then select your pipeline.

      2. Select the ellipsis, and then select Delete.

         

      3. Enter the pipeline name, and then select Delete to delete the pipeline.

   3. If you modified an existing workflow definition, undo the modifications for running the load test, and save the workflow.

2. Remove the service connection:

   1. Select Project settings > Service connections, and then select your service connection.
   2. Select Edit > Delete to remove the service connection.

1. Remove GitHub Actions changes:

   1. In GitHub, browse to your repository.
   2. If you created a new workflow definition, delete the workflow YAML file in the .github/workflows folder.
   3. If you modified an existing workflow definition, undo the modifications for running the load test, and save the workflow.

2. Remove the service principal:

   az ad sp delete --id $(az ad sp show --display-name "my-load-test-cicd" -o tsv)
   

1. Undo the changes in your CI workflow.

2. Remove the service principal:

   az ad sp delete --id $(az ad sp show --display-name "my-load-test-cicd" -o tsv)