Accelerating Forwarding Plane Performance
1/5/2021
This solution brief describes how Intel® Select Solutions for NFVI Forwarding Platform address the complexity that service providers face in choosing the right white-box infrastructure. It discusses Advantech SKY-8101D server configurations in detail and how it meets the Intel Select Solutions for NFVI Forwarding Platform criteria based on 2nd generation Intel® Xeon® Scalable processors. Ready to ship as pre-configured platforms, developers can now gain faster access to optimized and stable platforms to conduct testing and modeling of solutions that will help them define next-generation services.
Introduction
Intel Select Solutions provides workload optimized configurations across the data center, and for network specific workloads, has launched Intel Select Solutions for NFVI Forwarding Platform. Specifically targeted at vEPC, vUPF, vBNG & vCMTS, this solution helps developers by giving them an ultra-performant commercially viable and tested platform capable of sustained optimized data and control plane processing for workloads spanning 4G and 5G wireless functions as well as the wireline network gateway functions.
As communication service providers (CommSPs) gain more experience with NFV solutions based on Intel Select Solutions, they will gain from the flexibility enabled by a software-centric approach where a single edge NFVI platform can serve the evolving service needs of consumer, residential, and enterprise customer segments in both wireless and fixed networks.
Advantech verified Intel Select Solutions
Intel Select Solutions for NFVI defines the minimum NFVI hardware and software for specific application use cases and sets the baseline for performance.
For example, the SKY-8101D 1RU dual-socket server based on 2nd Gen Intel Xeon Scalable processors offers 200Gbps of PCIe bandwidth per socket, for up to 400Gbs per 1RU. This is ideal for applications that are inline (for example BNG) where 100Gbps upstream and 100Gbps downstream capacity per socket maximizes the number of serviceable user sessions.
While testing the platform with the Intel Select Solutions for NFVI Forwarding Platform scripts, Advantech recorded 319 Gbps of vBNG throughput on the SKY-8101D server integrating Intel® Ethernet 800 Series Network Adapters, while overall server power consumption was less than 550W. When testing this configuration with simple Layer 3 forwarding, a platform throughput of 396 Gbps (99% line rate) was achieved with 256-byte packets.
Tests were also performed which make use of Enhanced Dynamic Device Personalization (DDP) on the Intel Ethernet 800 Series which allows reconfiguration of the network adapter’s internal packet filtering and processing pipeline on-demand to meet specific use case needs. This is achieved by adding new configuration profiles to the Ethernet controllers at runtime without resetting or rebooting the server using the Data Plane Development Kit (DPDK).
This configuration profile provides the ability to classify packet types and protocols inline and distributes the packets to specific queues on the device host interface. These queues can be assigned to specific cores on the CPU. This enables application performance scale with the number of cores in the system improving overall performance and utilization. It also improves latency because the packets end up automatically on the right worker core. For example in a BNG application it is vital for performance that all the packet flows from the same CPE are handled by the same core to effectively enable technologies like billing & HQoS.
In addition, SKY-8101D server configuration integrating the Intel® Ethernet Network Adapter E810-CQDA2 also provides unique Application Device Queues (ADQ) capabilities. ADQ technology improves performance scalability and predictability by dedicating queues to key workloads, delivering predictable high performance with dramatically reduced jitter.
Server Hardware Requirements
This platform addresses general use cases for NFVI, focusing resources on I/O to provide the widest data path possible into each NUMA node. Optional components can be added to meet the requirements of specific use cases. Intel Optane DC persistent memory can be added to the configurations to provide massive memory resources that enlarge the pool of warm data that can be held in close proximity to the processor. User plane nodes are available in two primary configurations, with configurability to fine-tune the stack for specific solution needs: Base Node and Plus Node.
In addition, the reference architecture specifies system configuration parameters for the Intel Select Solutions for NFVI Forwarding Platform Controller Node.
The Advantech SKY-8101D is a verified Intel Select Solutions for NFVI Forwarding Platform and is designed for high throughput and reliability across the CommSP Network Infrastructure. It is built around the architectural and deterministic performance features of 2nd Generation Intel® Xeon Gold processors.
The system is made up of the following key components and technologies:
━ Balanced non-uniform memory access (NUMA) connectivity: I/O is evenly distributed across both CPU sockets. Workloads running on both sockets can benefit from direct access to network, storage (Non-Volatile Memory Express or NVMe drives), and Intel® QuickAssist Technology (Intel® QAT) acceleration.
━ High throughput network adapters: The SKY-8101D offers four NUMA balanced PCIe x16 Gen3 slots. For Plus node validation, four dual-port (QSFP28) 100Gb Intel Ethernet Network Adapters E810-CQDA2 were installed in the system.
━ Data Plane Development Kit (DPDK) to accelerate packet processing in the data path. It also facilitates building packet forwarders designed to operate on general-purpose, standards based servers.
━ Dynamic Device Personalization (DDP) is a programmable packet-processing pipeline provided by the Intel Ethernet 700 and 800 Series that supports on-demand reconfiguration of network controllers at runtime, enabling workload-specific optimizations to increase throughput and decrease latency.
━ Application Device Queues (ADQ) is a capability first implemented in the Intel Ethernet 800 Series that provides dedicated queues to key workloads, enabling application-specific data steering, signaling, and rate limiting using an optimized application thread-to-device data path. The ADQ innovation increases application response time predictability, reduces latency, and improves throughput.
━ Storage: 2 x 480 GB Intel® SATA Solid State Drives are configured as boot drives.
Advantech SKY-8101D - Intel Select Solution for NFVI Forwarding Platform Plus Node Configuration
The SKY-8101D is a high-end server optimized for computing power, accelerated workloads and high speed, high density I/O with optimum energy efficiency.
Two 2nd Gen Intel Xeon Scalable processors provide the latest architectural enhancements, including rebalanced cache hierarchy, and Intel® Ultra Path Interconnect (Intel® UPI) for increased bandwidth and transfer rates between sockets at up to 10.4GT/s.
In addition, the new Intel® Advanced Vector Extensions 512 (Intel® AVX- 512) Vector Neural Network Instruction (VNNI) extension increases the throughput of tight inner convolutional loop operations, reduces the memory bandwidth required to perform deep learning operations and will improve the performance of image matching algorithms on Advantech white box servers.
Each socket supports 6 memory channels and up to 12 DDR4 RDIMMs at 2666 MHz for up to 1536GB of ECC memory using the latest technology. Advanced RAS modes such as mirroring and sparing increase platform reliability.
The SKY-8101D’s thermal system design enables support for processors with up to 165W TDP. This allows the appliance to scale from 8 core CPUs to the highest performance 28 core processors available today.
With an abundance of PCI Express lanes, the SKY-8101D can support up to four full height 3/4 length (10.5”) PCIe x16 adapters for modular, configurable networking I/O and acceleration. PCIe Gen3 technology on all slots provides sufficient bandwidth to support multiple 40GbE 25GbE and 10GbE network adapters as well as the latest Intel Ethernet Network Adapters offering 100GbE connectivity. With integrated security and compression acceleration based on Intel QuickAssist Technology and two 10GbE ports with SR-IOV and RDMA support, the system offers best-in-class integration in a 1RU form factor.
Advanced Lights Out Management based on Advantech code base BMC and IPMI suite improves system manageability and reliability, providing platform thermal management, H/W monitoring and supervision. Remote firmware upgrade capability and hardware-based BIOS redundancy make the SKY-8101D an ideal platform for mission-critical and highly available networks.
Redundant power supplies, the ability to withstand single fan failures, redundant firmware images with failsafe upgrades and hot swappable FRUs make the SKY-8101D the platform of choice for applications requiring zero downtime.
The SKY-8101D is CE, FCC, UL, CB, CCC, and RoHS compliant.
Table 1 shows the exact configuration of the SKY-8101D and compares it to the reference specifications.
Verified Performance Throughput Benchmark Testing
Software and Firmware Stack
Enhanced Features
━ Remote Intelligent Platform Monitoring & Control
■ Integrated IPMI Based Management Controller
■ Development, Customization, Validation and Life Cycle Management
■ Standard and Advanced IPMI Features
━ Redundant BIOS & Fail-Safe Remote BMC/BIOS Upgrade
■ Physical Redundant Flashes for Current/Backup BIOS
■ x86 BIOS Upgradable by BMC and ABU (Advantech BIOS Utility)
■ Industry Standard HPM.1 Protocol
■ Watchdog Mechanism to Detect Failing / Corrupted BIOS
■ Rollback Mechanism for System Recovery if BIOS Upgrade Fails
■ Dedicated Update Utility (ABU)
Remote Evaluation Service
With RES, developers can get ahead of the curve and begin to test different NFV infrastructures on platforms destined for deployment closer to the subscriber in the access network, mobile edge and in customer premises (uCPE) as well as the network core and telecom data center.
Download PDFIf you would like to download a PDF version of this Solution Brief please click here
Advantech Contact Information
If you would like to download a PDF version of this Solution Brief please click here
Email: cloud.iot@advantech.com
Regional phone numbers can be found on our website at https://www.advantech.com/contact/ https://www.advantech.com/nc
Intel, the Intel logo, and Xeon are trademarks of Intel Corporation or its subsidiaries
Copyright Advantech 2020