Quality of Experience - Affirmed MCC Data Product overview

The Quality of Experience - Affirmed MCC Data Products support data analysis and insight for operators of the Affirmed Networks Mobile Content Cloud (MCC). They ingest Event Data Records (EDRs) from MCC network elements, and then digest and enrich this data to provide a range of visualizations for the operator. Operator data scientists have access to the underlying enriched data to support further data analysis.

Background

The Affirmed Networks Mobile Content Cloud (MCC) is a virtualized Evolved Packet Core (vEPC) that can provide the following functionality.

  • Serving Gateway (SGW) routes and forwards user data packets between the RAN and the core network.
  • Packet Data Network Gateway (PGW) provides interconnect between the core network and external IP networks.
  • Gi-LAN Gateway (GIGW) provides subscriber-aware or subscriber-unaware value-added services (VAS) without enabling MCC gateway services, allowing operators to take advantage of VAS while still using their incumbent gateway.
  • Gateway GPRS support node (GGSN) provides interworking between the GPRS network and external packet switched networks.
  • Serving GPRS support node and MME (SGSN/MME) is responsible for the delivery of data packets to and from the mobile stations within its geographical service area.
  • Control and User Plane Separation (CUPS), an LTE enhancement that separates control and user plane function to allow independent scaling of functions.

The data produced by the MCC varies according to the functionality. This variation affects the enrichments and visualizations that are relevant. Azure Operator Insights provides the following Quality of Experience Data Products to support specific MCC functions.

  • Quality of Experience - Affirmed MCC GIGW
  • Quality of Experience - Affirmed MCC PGW/GGSN

Data types

The following data types are provided for all Quality of Experience - Affirmed MCC Data Products.

  • edr contains data from the Event Data Records (EDRs) written by the MCC network elements. EDRs record each significant event arising during calls or sessions handled by the MCC. They provide a comprehensive record of what happened, allowing operators to explore both individual problems and more general patterns. The Data Product supports the following EDRs.

    • Status
    • Session
    • Bearer
    • Flow
    • HTTP
    • RTT
    • MME CRR
    • SGSN CRR

    Note

    Both kinds of CRR records are stored in the all_mme_sgsn_events table.

  • edr-sanitized contains data from the edr data type but with personal data suppressed. Sanitized data types can be used to support data analysis while also enforcing subscriber privacy.

  • edr-validation: This data type contains a subset of performance management statistics and provides you with the ability to optionally ingest a minimum number of PMstats tables for a data quality check.

  • device: This optional data type contains device data (for example, device model, make and capabilities) that the Data Product can use to enrich the MCC Event Data Records. To use this data type, you must upload the device reference data in a CSV file. The CSV must conform to the Device reference schema for the Quality of Experience Affirmed MCC Data Product.

  • enrichment: This data type holds the enriched Event Data Records and covers multiple sub data types for precomputed aggregations targeted to accelerate specific dashboards, granularities, and queries. These multiple sub data types include:

    • agg-enrichment-5m: contains enriched Event Data Records aggregated over five-minute intervals.
    • agg-enrichment-1h: contains enriched Event Data Records aggregated over one-hour intervals.
    • agg-enrichment-1d: contains enriched Event Data Records aggregated over one-day intervals.
    • enriched-flow-dcount: contains precomputed counts used to report the unique IMSIs, MCCs, and Applications over time.
  • location: This optional data type contains data enriched with location information, if you have a source of location data. This covers the following sub data types.

    • agg-location-5m: contains enriched location data aggregated over five-minute intervals.
    • agg-location-1h: contains enriched location data aggregated over one-hour intervals.
    • agg-location-1d: contains enriched location data aggregated over one-day intervals.
    • enriched-loc-dcount: contains precomputed counts used to report location data over time.
  • agg-functions: This data type contains functions used in the visualizations to conditionally select different data sources depending on the given parameters.

Setup

To use the Quality of Experience - Affirmed MCC Data Product:

Required ingestion configuration

Use the information in this section to configure your ingestion method. Refer to the documentation for your chosen method to determine how to supply these values.

Data type Required container name Requirements for data
edr edr MCC EDR data.
device device Device reference data.
edr-validation edr-validation PM Stat data for EDR_HTTP_STATS, EDR_FLOW_STATS, and EDR_SESSION_STATS datasets. File name prefixes must match the name of the dataset.

Requirements for the Azure Operator Insights ingestion agent

Use the VM requirements to set up one or more VMs for the ingestion agent. Use the example configuration to configure the ingestion agent to upload data to the Data Product, as part of following Install the Azure Operator Insights ingestion agent and configure it to upload data.

VM requirements

Each agent instance must run on its own Linux VM. The number of VMs needed depends on the scale and redundancy characteristics of your deployment. This recommended specification can achieve 1.5-Gbps throughput on a standard D4s_v3 Azure VM. For any other VM spec, we recommend that you measure throughput at the network design stage.

Latency on the MCC to agent connection can negatively affect throughput. Latency should usually be low if the MCC and agent are colocated or the agent runs in an Azure region close to the MCC.

Talk to the Affirmed Support Team to determine your requirements.

Each VM running the agent must meet the following minimum specifications for EDR ingestion.

Resource Requirements
OS Red Hat Enterprise Linux 8.6 or later, or Oracle Linux 8.8 or later
vCPUs 4
Memory 32 GB
Disk 64 GB
Network Connectivity from MCCs and to Azure
Software systemd, logrotate, and zip installed
Other SSH or alternative access to run shell commands
DNS (Preferable) Ability to resolve Microsoft hostnames. If not, you need to perform extra configuration when you set up the agent (described in Map Microsoft hostnames to IP addresses for ingestion agents that can't resolve public hostnames.)

Deploying multiple VMs for fault tolerance

The ingestion agent is designed to be highly reliable and resilient to low levels of network disruption. If an unexpected error occurs, the agent restarts and provides service again as soon as it's running.

The agent doesn't buffer data, so if a persistent error or extended connectivity problems occur, EDRs are dropped.

For extra fault tolerance, you can deploy multiple instances of the ingestion agent and configure the MCC to switch to a different instance if the original instance becomes unresponsive, or to share EDR traffic across a pool of agents. For more information, see the Affirmed Networks Active Intelligent vProbe System Administration Guide (only available to customers with Affirmed support) or speak to the Affirmed Networks Support Team.

Configuration for Affirmed MCCs

After installing and configuring your ingestion agents, configure the MCCs to send EDRs to them.

Follow the steps in "Generating SESSION, BEARER, FLOW, and HTTP Transaction EDRs" in the Affirmed Networks Active Intelligent vProbe System Administration Guide (only available to customers with Affirmed support), making the following changes:

  • Replace the IP addresses of the MSFs in MCC configuration with the IP addresses of the VMs running the ingestion agents.

  • Confirm that the following EDR server parameters are set.

    • port: 36001
    • encoding: protobuf
    • keep-alive: 2 seconds

Configuration for Affirmed EMS

If you're using the edr-validation data type, configure the EMS to export the relevant performance management statistics to a remote server. If you're using the Azure Operator Insights ingestion agent to ingest performance management statistics, the remote server must be an SFTP server, otherwise the remote server needs to be accessible by your ingestion method.

  1. Obtain the IP address, user, and password of the remote server.
  2. Configure the transfer of EMS statistics to a remote server

Important

Increase the frequency of the cron job by reducing the timeInterval argument from 15 (default) to 5 minutes.

Note

Affirmed Networks login credentials are required to access the MCC product documentation.