Blog Post

Apps on Azure Blog
15 MIN READ

Qwen3.8-Flash-Next on two H100s in an Azure Spot VM

Wuyi_Weng's avatar
Wuyi_Weng
Icon for Microsoft rankMicrosoft
Oct 12, 2026

How to serve a 125B mixture-of-experts model on a two-GPU Azure Spot VM with vLLM, and what its metrics, traces and GPU counters show when coding agents use it.

With 150,000 tokens of context, one request to Qwen3.8-Flash-Next decoded at about 200 tokens a second, and its first token arrived in under a second, because 95% of the prompt came from the cache. T...
Four hours of agent traffic on the h100-llm dashboard: request and token-rate tiles, then input tokens per second split into prefix-cache hits and computed prefill, which grows after 04:15, next to output tokens per second
Updated Oct 30, 2026
Version 2.0