Quality of Experience - Affirmed MCC Data Product overview
The Quality of Experience - Affirmed MCC Data Products support data analysis and insight for operators of the Affirmed Networks Mobile Content Cloud (MCC). They ingest Event Data Records (EDRs) from MCC network elements, and then digest and enrich this data to provide a range of visualizations for the operator. Operator data scientists have access to the underlying enriched data to support further data analysis.
Background
The Affirmed Networks Mobile Content Cloud (MCC) is a virtualized Evolved Packet Core (vEPC) that can provide the following functionality.
- Serving Gateway (SGW) routes and forwards user data packets between the RAN and the core network.
- Packet Data Network Gateway (PGW) provides interconnect between the core network and external IP networks.
- Gi-LAN Gateway (GIGW) provides subscriber-aware or subscriber-unaware value-added services (VAS) without enabling MCC gateway services, allowing operators to take advantage of VAS while still using their incumbent gateway.
- Gateway GPRS support node (GGSN) provides interworking between the GPRS network and external packet switched networks.
- Serving GPRS support node and MME (SGSN/MME) is responsible for the delivery of data packets to and from the mobile stations within its geographical service area.
- Control and User Plane Separation (CUPS), an LTE enhancement that separates control and user plane function to allow independent scaling of functions.
The data produced by the MCC varies according to the functionality. This variation affects the enrichments and visualizations that are relevant. Azure Operator Insights provides the following Quality of Experience Data Products to support specific MCC functions.
- Quality of Experience - Affirmed MCC GIGW
- Quality of Experience - Affirmed MCC PGW/GGSN
Data types
The following data types are provided for all Quality of Experience - Affirmed MCC Data Products.
edr
contains data from the Event Data Records (EDRs) written by the MCC network elements. EDRs record each significant event arising during calls or sessions handled by the MCC. They provide a comprehensive record of what happened, allowing operators to explore both individual problems and more general patterns. The Data Product supports the following EDRs.Status
Session
Bearer
Flow
HTTP
RTT
MME CRR
SGSN CRR
Note
Both kinds of
CRR
records are stored in theall_mme_sgsn_events
table.edr-sanitized
contains data from theedr
data type but with personal data suppressed. Sanitized data types can be used to support data analysis while also enforcing subscriber privacy.edr-validation
: This data type contains a subset of performance management statistics and provides you with the ability to optionally ingest a minimum number of PMstats tables for a data quality check.device
: This optional data type contains device data (for example, device model, make and capabilities) that the Data Product can use to enrich the MCC Event Data Records. To use this data type, you must upload the device reference data in a CSV file. The CSV must conform to the Device reference schema for the Quality of Experience Affirmed MCC Data Product.enrichment
: This data type holds the enriched Event Data Records and covers multiple sub data types for precomputed aggregations targeted to accelerate specific dashboards, granularities, and queries. These multiple sub data types include:agg-enrichment-5m
: contains enriched Event Data Records aggregated over five-minute intervals.agg-enrichment-1h
: contains enriched Event Data Records aggregated over one-hour intervals.agg-enrichment-1d
: contains enriched Event Data Records aggregated over one-day intervals.enriched-flow-dcount
: contains precomputed counts used to report the unique IMSIs, MCCs, and Applications over time.
location
: This optional data type contains data enriched with location information, if you have a source of location data. This covers the following sub data types.agg-location-5m
: contains enriched location data aggregated over five-minute intervals.agg-location-1h
: contains enriched location data aggregated over one-hour intervals.agg-location-1d
: contains enriched location data aggregated over one-day intervals.enriched-loc-dcount
: contains precomputed counts used to report location data over time.
agg-functions
: This data type contains functions used in the visualizations to conditionally select different data sources depending on the given parameters.
Setup
To use the Quality of Experience - Affirmed MCC Data Product:
- Deploy the Data Product by following Create an Azure Operator Insights Data Product.
- Configure your network to provide data either using your own ingestion method, or by setting up the Azure Operator Insights ingestion agent.
- Use the information in Required ingestion configuration when you're setting up ingestion.
- We recommend the Azure Operator Insights ingestion agent for the
edr
data type. To ingest thedevice
andedr-validation
data types, you can use a separate instance of the ingestion agent, or set up your own ingestion method. - If you're using the Azure Operator Insights ingestion agent, also meet the requirements in Requirements for the Azure Operator Insights ingestion agent.
- Configure your Affirmed MCCs to send EDRs to the ingestion agent. See Configuration for Affirmed MCCs.
- If you're using the
edr-validation
data type, configure your Affirmed EMS to export performance management stats to a remote server. See Configuration for Affirmed EMS.
Required ingestion configuration
Use the information in this section to configure your ingestion method. Refer to the documentation for your chosen method to determine how to supply these values.
Data type | Required container name | Requirements for data |
---|---|---|
edr |
edr |
MCC EDR data. |
device |
device |
Device reference data. |
edr-validation |
edr-validation |
PM Stat data for EDR_HTTP_STATS , EDR_FLOW_STATS , and EDR_SESSION_STATS datasets. File name prefixes must match the name of the dataset. |
Requirements for the Azure Operator Insights ingestion agent
Use the VM requirements to set up one or more VMs for the ingestion agent. Use the example configuration to configure the ingestion agent to upload data to the Data Product, as part of following Install the Azure Operator Insights ingestion agent and configure it to upload data.
VM requirements
Each agent instance must run on its own Linux VM. The number of VMs needed depends on the scale and redundancy characteristics of your deployment. This recommended specification can achieve 1.5-Gbps throughput on a standard D4s_v3 Azure VM. For any other VM spec, we recommend that you measure throughput at the network design stage.
Latency on the MCC to agent connection can negatively affect throughput. Latency should usually be low if the MCC and agent are colocated or the agent runs in an Azure region close to the MCC.
Talk to the Affirmed Support Team to determine your requirements.
Each VM running the agent must meet the following minimum specifications for EDR ingestion.
Resource | Requirements |
---|---|
OS | Red Hat Enterprise Linux 8.6 or later, or Oracle Linux 8.8 or later |
vCPUs | 4 |
Memory | 32 GB |
Disk | 64 GB |
Network | Connectivity from MCCs and to Azure |
Software | systemd, logrotate, and zip installed |
Other | SSH or alternative access to run shell commands |
DNS | (Preferable) Ability to resolve Microsoft hostnames. If not, you need to perform extra configuration when you set up the agent (described in Map Microsoft hostnames to IP addresses for ingestion agents that can't resolve public hostnames.) |
Deploying multiple VMs for fault tolerance
The ingestion agent is designed to be highly reliable and resilient to low levels of network disruption. If an unexpected error occurs, the agent restarts and provides service again as soon as it's running.
The agent doesn't buffer data, so if a persistent error or extended connectivity problems occur, EDRs are dropped.
For extra fault tolerance, you can deploy multiple instances of the ingestion agent and configure the MCC to switch to a different instance if the original instance becomes unresponsive, or to share EDR traffic across a pool of agents. For more information, see the Affirmed Networks Active Intelligent vProbe System Administration Guide (only available to customers with Affirmed support) or speak to the Affirmed Networks Support Team.
Configuration for Affirmed MCCs
After installing and configuring your ingestion agents, configure the MCCs to send EDRs to them.
Follow the steps in "Generating SESSION, BEARER, FLOW, and HTTP Transaction EDRs" in the Affirmed Networks Active Intelligent vProbe System Administration Guide (only available to customers with Affirmed support), making the following changes:
Replace the IP addresses of the MSFs in MCC configuration with the IP addresses of the VMs running the ingestion agents.
Confirm that the following EDR server parameters are set.
port
: 36001encoding
: protobufkeep-alive
: 2 seconds
Configuration for Affirmed EMS
If you're using the edr-validation
data type, configure the EMS to export the relevant performance management statistics to a remote server. If you're using the Azure Operator Insights ingestion agent to ingest performance management statistics, the remote server must be an SFTP server, otherwise the remote server needs to be accessible by your ingestion method.
- Obtain the IP address, user, and password of the remote server.
- Configure the transfer of EMS statistics to a remote server
- Use the instructions in Copying Performance Management Statistics Files to Destination Server in the Acuitas User's Guide.
- For
edr-validation
, you only need to export three CSV files. List these file names in theopt/Affirmed/NMS/conf/pm/mcc.files.txt
file on the EMS:EDR_HTTP_STATS
EDR_FLOW_STATS
EDR_SESSION_STATS
Important
Increase the frequency of the cron job by reducing the timeInterval
argument from 15
(default) to 5
minutes.
Related content
- Data Quality Monitoring
- Azure Operator Insights Data Types
- Monitoring - Affirmed MCC Data Product
- Affirmed Networks MCC documentation
Note
Affirmed Networks login credentials are required to access the MCC product documentation.
Feedback
https://aka.ms/ContentUserFeedback.
Coming soon: Throughout 2024 we will be phasing out GitHub Issues as the feedback mechanism for content and replacing it with a new feedback system. For more information see:Submit and view feedback for