Today, we're excited to announce the public preview of Guest RDMA on Azure Boost, available in all regions.
Guest RDMA on Azure Boost extends Remote Direct Memory Access (RDMA) directly into guest VMs over the front-end Network Interface Card (NIC). Applications interact natively with RDMA verbs while the Azure Boost NIC offloads transport processing, bypassing the guest networking stack for RDMA data paths and reducing host CPU consumption. This enables low-latency, high-throughput communication without requiring specialized HPC VM families, allowing customers to deploy RDMA-enabled distributed systems on standard general-purpose Azure VMs.
RDMA Key Benefits:
Lower tail latency and faster completion times through kernel bypass and hardware accelerated transport processing.
Higher throughput per CPU core, enabling significantly higher message rates and up to 100 Gb/s single connection throughput (subject to the VM’s configured network bandwidth limits).
Applications that involve frequent or large data transfers benefit most from RDMA, including:
- AI/ML training and inference – Guest RDMA supports GPU Direct RDMA, enabling checkpointing and KV cache movement between GPU hosts and memory rich VMs with minimal CPU overhead, improving both throughput and latency for distributed training and inference.
- Distributed storage systems – Azure Boost supports both kernel mode RDMA (e.g., NFS) and user mode RDMA (e.g., shared memory and database workloads), enabling high throughput and low CPU utilization for storage and data platforms.
- High-Performance Computing (HPC) – RDMA provides low latency, high bandwidth VM to VM communication, which is critical for tightly coupled, communication intensive HPC applications.
Customer Testimony:
Silk:
"Silk exists to give the most demanding databases and AI workloads on Azure the lowest possible storage latency. Working closely with Microsoft engineering, we validated Azure Guest RDMA against our toughest storage traffic patterns: multiple concurrent RDMA connections, multi-channel redundant I/O paths, and sustained high-throughput, mixed read/write workloads. In our testing, Guest RDMA reduced end-to-end latency by up to 78% compared with standard VM networking on the same hardware. Guest RDMA removes a significant layer of network overhead inside the VM, which lets Silk deliver even higher, more consistent performance for customers running SQL Server, Oracle, and AI workloads on Azure."
Azure Blob Storage:
"Guest RDMA unlocks a high-speed data path directly within Azure VMs, providing the foundation for Blob over RDMA (https://aka.ms/bloboverrdmapreview). Together, they create a new expressway for data-intensive workloads, reducing latency and CPU overhead while using compute and GPU resources more efficiently."
Supported VM sizes:
For public preview, we've extended Guest RDMA to Azure Boost general-purpose VM sizes built on Intel’s 5th GenerationXeon® Platinum 8573C (Emerald Rapids) processor and AMD's 5th Generation EPYC™ 9005 processor. These include general purpose, memory optimized, compute optimized, storage optimized, network optimized, and remote storage optimized families.
|
CPU |
Family |
Series |
|
Intel |
General purpose |
Dlsv6, Dldsv6, Dsv6, Ddsv6 |
| Intel |
Memory optimized |
Esv6, Edsv6 |
| Intel |
Storage optimized |
Lsv4 |
| Intel |
Network optimized |
Dnlsv6, Dnldsv6, Dnsv6, Dndsv6, Ensv6, Endsv6 |
| Intel |
Remote storage optimized |
Ebsv6, Ebdsv6 |
| Intel |
Compute optimized |
FXmsv2, FXmdsv2 |
|
AMD |
General purpose |
Dalsv7, Daldsv7, Dasv7, Dadsv7 |
| AMD |
Memory optimized |
Easv7, Eadsv7 |
| AMD |
Compute optimized |
Falsv7, Faldsv7 |
| AMD |
Storage optimized |
Lasv5, Laosv5 |
Enabling RDMA in Guest VMs:
To enable Guest RDMA, create VMs using the following guidelines:
- Recommended Linux Supported Distribution: Ubuntu 24.04 LTS
- Required user-space packages: >= rdma-core (50.0-2ubuntu0.2)
- Supported Kernel to use: >=6.8.0 - 1044-azure, recommend 6.17 if available
ARM Template Enablement:
To enable Guest RDMA, use API version 2026-07-01 for the network interface and set default enableGuestRdma from null to true, with Accelerated Networking enabled.
Example:
{
"type": "Microsoft.Network/networkInterfaces",
"apiVersion": "2026-07-01",
"properties": {
"enableAcceleratedNetworking": true,
"enableGuestRdma": true
}
}
Sign Up Contact:
We'd love to hear your thoughts — please share any feedback by emailing us at guestrdmapreview@microsoft.com.