Blog Post

Microsoft Foundry Blog
4 MIN READ

A New Chapter for Realtime AI: Reasoning, Translation, and Real-Time Transcription

Naomi Moneypenny's avatar
May 07, 2026

Three models. One moment. Here's what's shipping and why it matters for developers building AI voice applications.

Voice can be one of the most direct and productive interfaces for AI — enabling customer support agents that may resolve issues without a single keystroke, live multilingual communication that can take on language barriers as conversations happen, and voice assistants capable of reasoning through complex requests in real time. Developers building these experiences need models that can keep pace with increasingly demanding latency, accuracy, and language coverage requirements. OpenAI’s GPT-realtime-translate, GPT‑realtime‑2 and, GPT-realtime-whisper are now available in Microsoft Foundry — together representing a significant step forward for the realtime model lineup available to developers on the platform.

GPT-realtime-translate and GPT-realtime-whisper

GPT-realtime-translate and GPT-realtime-whisper together extend the realtime stack for live multilingual audio workflows. GPT-realtime-translate is built for continuous, real-time translation, producing translated output as speech unfolds without relying on segmented pipeline processing, while GPT-realtime-whisper provides low-latency streaming transcription of the original audio in parallel. Used together, they help developers support scenarios such as live events, cross-language customer experiences, captions, monitoring, and archival workflows that require both translated output and visibility into the source speech.

  • Continuous stream processing: This new model translates live audio without segmenting or buffering allowing for more natural interactions.
  • New translation and transcription capabilities: Translate between languages in real time and observe faster text to speech.
  • Available via the Realtime API

GPT-realtime-2

GPT‑realtime‑2 is a generational upgrade to OpenAI's speech-to-speech model, bringing internal reasoning and an expanded context window to real-time voice applications. Where previous speech to speech models responded immediately, GPT‑realtime‑2 can work through a problem before speaking — making it well suited for voice applications that need to handle complex, multi-step queries entirely in the audio layer without routing to a separate text pipeline.

  • Native reasoning capability: The newest realtime model introduces stronger reasoning capabilities. Now the model thinks internally before responding.
  • Adjustable reasoning effort via {reasoning.effort}: Explicitly request the level of reasoning the model uses -- minimal, low, medium, high – to save on cost and latency.
  • Audio in, audio out: No need for an intermediary text step, conversation stays fluid and natural.
  • Available via the Realtime API

Use cases

These models work independently, but they're designed to complement each other in real-world pipelines:

  • Live multilingual events. GPT-realtime-translate enables real-time translation of live audio, producing translated speech along with a transcript in the target language. GPT‑realtime‑whisper can be used in parallel to capture a transcription of the original speech for captions, monitoring, or archival purposes. Together, they enable multilingual live streaming with both translated experiences and visibility into the source language.
  • Global customer support. Route inbound calls through GPT-realtime-translate to translate conversations in real time and provide a translated transcript for agents. Use GPT‑realtime‑whisper alongside it to capture the original conversation as text for compliance, quality review, or analytics. Then pass the interaction to an agent built with GPT‑realtime‑2 using {reasoning.effort}: high for complex issue resolution, all within a continuous audio pipeline.
  • International voice assistants. Build once and deploy across languages. GPT-realtime-translate enables multilingual interaction and provides translated output with a target-language transcript, while GPT‑realtime‑whisper can optionally capture the original user input as text. GPT‑realtime‑2 manages reasoning and conversational context, supporting more complex voice interactions.

Pricing

Model

Deployment

Modality

Pricing per 1M tokens

Input

Cached Input

Output

GPT-realtime-2

Global Standard

Audio

$32.00

$0.40

$64.00

Text

$4.00

$0.40

$24.00

Image

$5.00

$0.50

--

GPT-realtime-translate

Global Standard

Audio

--

--

$2.04/hour

GPT-realtime-whisper 

Global Standard

Audio

--

--

$1.02/hour

GPT-realtime-2.1

Global Standard

Audio

 $32.00

 $0.40

 $64.00

Text

$4.00

$0.40 

 $24.00

Image

 $5.00

 $0.50

 --

GPT-realtime-2.1-mini

Global Standard

Audio

 $10

$0.30 

$20 

Text

 $0.60$0.06 

$2.40

Image

$0.80

 $0.08 

 --

*Pricing for GPT-realtime-translate and GPT-realtime-whisper will be done by the hour

Getting Started

Looking for ways to dive in? GPT-realtime-translate, GPT-realtime-whisper, and GPT‑realtime‑2 are in Microsoft Foundry now. Explore the model catalog and start building: https://ai.azure.com

Learn more here:

 

Update 7/7/2026

Microsoft Foundry welcomes two new models to the Azure Open AI collection: GPT-realtime-2.1 and GPT-realtime-2.1-mini. These models are point upgrades to the realtime-2, with the mini model being a new variant designed for low cost scenarios.

Updated Jul 08, 2026
Version 5.0

5 Comments

  • sjmakin's avatar
    sjmakin
    Copper Contributor

    GPT-realtime-2 still not available nearly 1 week on from announcing it was going to be released 'today'. The whisper models are available, but we are missing the main realtime voice to voice model. Whats going on Naomi Moneypenny​  Dave_Jacobs​?

  • yelinz's avatar
    yelinz
    Copper Contributor

    Not in the general catalog https://ai.azure.com/catalog  or in the foundry catalogs in eastus or swedencentral.
    What are the timelines for the actual rollout?

  • Hi! I'd like to start using GPT-realtime-2 but do not see it in the foundry yet. The only options I see are `gpt-realtime` and `gpt-realtime-1.5`. Could you please look into this issue?

  • DavidMoreno's avatar
    DavidMoreno
    Copper Contributor

    Hi,

    When is Realtime 2 scheduled for release, and which regions will it be available in?

  • ross2's avatar
    ross2
    Copper Contributor

    New models not available in our subscription. No indication anywhere of how or who to contact to request them. Why does MS do this for every foundry release you guys are making it really hard to love foundry.

     

    % az cognitiveservices account list-models \

    --resource-group AIFOUNDRY-REALTIME \

    --name XXXX \

    -o json | jq '.[] | select((.name // "") | contains("gpt-realtime"))'

     

    {

    "baseModel": null,

    "callRateLimit": null,

    "capabilities": {

    "assistants": "false",

    "chatCompletion": "false",

    "completion": "false",

    "realtime": "true"

    },

    "deprecation": {

    "fineTune": null,

    "inference": "2027-02-28T00:00:00Z"

    },

    "finetuneCapabilities": null,

    "format": "OpenAI",

    "isDefaultVersion": false,

    "lifecycleStatus": "GenerallyAvailable",

    "maxCapacity": 3,

    "name": "gpt-realtime",

    "skus": [

    {

    "capacity": {

    "default": 100,

    "maximum": 30000,

    "minimum": null,

    "step": null

    },

    "deprecationDate": "2027-02-28T00:00:00+00:00",

    "name": "GlobalStandard",

    "rateLimits": [

    {

    "count": 20.0,

    "key": "request",

    "renewalPeriod": 60.0,

    "rules": null

    },

    {

    "count": 10000.0,

    "key": "token",

    "renewalPeriod": 60.0,

    "rules": null

    }

    ],

    "usageName": "OpenAI.GlobalStandard.gpt-realtime"

    }

    ],

    "source": null,

    "systemData": {

    "createdAt": "2025-08-28T00:00:00+00:00",

    "createdBy": "Microsoft",

    "createdByType": "Application",

    "lastModifiedAt": "2025-08-28T00:00:00+00:00",

    "lastModifiedBy": "Microsoft",

    "lastModifiedByType": "Application"

    },

    "version": "2025-08-28"

    }

    {

    "baseModel": null,

    "callRateLimit": null,

    "capabilities": {

    "assistants": "false",

    "chatCompletion": "false",

    "completion": "false",

    "realtime": "true"

    },

    "deprecation": {

    "fineTune": null,

    "inference": "2027-04-07T00:00:00Z"

    },

    "finetuneCapabilities": null,

    "format": "OpenAI",

    "isDefaultVersion": false,

    "lifecycleStatus": "GenerallyAvailable",

    "maxCapacity": 3,

    "name": "gpt-realtime-mini",

    "skus": [

    {

    "capacity": {

    "default": 100,

    "maximum": 30000,

    "minimum": null,

    "step": null

    },

    "deprecationDate": "2027-04-07T00:00:00+00:00",

    "name": "GlobalStandard",

    "rateLimits": [

    {

    "count": 10.0,

    "key": "request",

    "renewalPeriod": 60.0,

    "rules": null

    },

    {

    "count": 5000.0,

    "key": "token",

    "renewalPeriod": 60.0,

    "rules": null

    }

    ],

    "usageName": "OpenAI.GlobalStandard.gpt-realtime-mini"

    }

    ],

    "source": null,

    "systemData": {

    "createdAt": "2025-10-06T00:00:00+00:00",

    "createdBy": "Microsoft",

    "createdByType": "Application",

    "lastModifiedAt": "2025-10-06T00:00:00+00:00",

    "lastModifiedBy": "Microsoft",

    "lastModifiedByType": "Application"

    },

    "version": "2025-10-06"

    }

    {

    "baseModel": null,

    "callRateLimit": null,

    "capabilities": {

    "assistants": "false",

    "chatCompletion": "false",

    "completion": "false",

    "realtime": "true"

    },

    "deprecation": {

    "fineTune": null,

    "inference": "2026-12-15T00:00:00Z"

    },

    "finetuneCapabilities": null,

    "format": "OpenAI",

    "isDefaultVersion": true,

    "lifecycleStatus": "GenerallyAvailable",

    "maxCapacity": 3,

    "name": "gpt-realtime-mini",

    "skus": [

    {

    "capacity": {

    "default": 100,

    "maximum": 30000,

    "minimum": null,

    "step": null

    },

    "deprecationDate": "2026-12-15T00:00:00+00:00",

    "name": "GlobalStandard",

    "rateLimits": [

    {

    "count": 3.0,

    "key": "request",

    "renewalPeriod": 60.0,

    "rules": null

    },

    {

    "count": 10000.0,

    "key": "token",

    "renewalPeriod": 60.0,

    "rules": null

    }

    ],

    "usageName": "OpenAI.GlobalStandard.gpt-realtime-mini"

    }

    ],

    "source": null,

    "systemData": {

    "createdAt": "2025-12-11T00:00:00+00:00",

    "createdBy": "Microsoft",

    "createdByType": "Application",

    "lastModifiedAt": "2025-12-11T00:00:00+00:00",

    "lastModifiedBy": "Microsoft",

    "lastModifiedByType": "Application"

    },

    "version": "2025-12-15"

    }

    {

    "baseModel": null,

    "callRateLimit": null,

    "capabilities": {

    "assistants": "false",

    "chatCompletion": "false",

    "completion": "false",

    "realtime": "true"

    },

    "deprecation": {

    "fineTune": null,

    "inference": "2027-02-23T00:00:00Z"

    },

    "finetuneCapabilities": null,

    "format": "OpenAI",

    "isDefaultVersion": false,

    "lifecycleStatus": "GenerallyAvailable",

    "maxCapacity": 3,

    "name": "gpt-realtime-1.5",

    "skus": [

    {

    "capacity": {

    "default": 100,

    "maximum": 30000,

    "minimum": null,

    "step": null

    },

    "deprecationDate": "2027-02-23T00:00:00+00:00",

    "name": "GlobalStandard",

    "rateLimits": [

    {

    "count": 20.0,

    "key": "request",

    "renewalPeriod": 60.0,

    "rules": null

    },

    {

    "count": 10000.0,

    "key": "token",

    "renewalPeriod": 60.0,

    "rules": null

    }

    ],

    "usageName": "OpenAI.GlobalStandard.gpt-realtime-1.5"

    }

    ],

    "source": null,

    "systemData": {

    "createdAt": "2026-02-23T00:00:00+00:00",

    "createdBy": "Microsoft",

    "createdByType": "Application",

    "lastModifiedAt": "2026-02-23T00:00:00+00:00",

    "lastModifiedBy": "Microsoft",

    "lastModifiedByType": "Application"

    },

    "version": "2026-02-23"

    }