Blog Post

Microsoft USB Blog
9 MIN READ

Introducing RDMA over USB4® on Windows: run larger local AI models across PCs

Ugan-Sivagnanenthirarajah's avatar
Nov 19, 2026

A developer preview that connects Windows PCs over USB4® so a compatible inference framework can run one model across their combined memory and GPU compute, using NetworkDirect, the same API Windows uses with datacenter RDMA adapters

Many of today's most capable open weight AI models don't fit in a typical PC's memory. When a model is too big for one machine, the usual options are to shrink it, send the work to the cloud, or buil...
Updated Nov 19, 2026
Version 2.0