Blog Post

Azure High Performance Computing (HPC) Blog
5 MIN READ

Running DeepSeek-R1 on a single NDv5 MI300X VM

jesselopez's avatar
jesselopez
Icon for Microsoft rankMicrosoft
Feb 01, 2025
Contributors: Davide Vanzo, Yuval Mazor, Jesse Lopez   DeepSeek-R1 is an open-weights reasoning model built on DeepSeek-V3, designed for conversational AI, coding, and complex problem-solving. It...
Updated Apr 15, 2025
Version 11.0
ai infrastructure
hpc
virtual machines
huqianghui's avatar
huqianghui
Icon for Microsoft rankMicrosoft
Mar 21, 2025

The Docker Repo: rocm has been deleted. And the dock image cannot be found.

Do you have recommended and alternative Docker images?

I tried lmsysorg/sglang:v0.4.4.post1-rocm630, but it doesn’t seem to work.

  • jesselopez's avatar
    jesselopez
    Icon for Microsoft rankMicrosoft
    Mar 24, 2025

    Hi Qianghui, I've updated the container image following AMD guidance.