Azure OpenAI Service Announces New Models and Multimodal Advancements at Microsoft Ignite 2023

Microsoft

Nov 15, 2023

At the beginning of 2023, we launched Azure OpenAI Service, promising an evolving ecosystem that adapts to the growing needs of developers and organizations. As we approach the one-year mark, we are humbled by more than 18,000 customers around the world defining generative AI with Azure. Today, we're excited to announce a significant expansion of the service, ushering in a new era of possibilities for multimodal use cases, customization and creative expression.

GPT-4 Turbo with Vision: A Visionary Preview

Public Preview Coming at the End of the Year

Get ready for the upcoming public preview of GPT-4-Turbo with Vision. This integration of language and vision promises to unlock new possibilities in understanding and generating content. If you think prompting with words is fun, wait until you try images and videos too.

DALL·E 3: Expanding Creativity

Public Preview

Adding to our innovation, we introduce DALL·E 3, an image model that you can prompt with text. This model empowers users to explore new frontiers in creative expression, providing a unique experience at the intersection of language and visual art. Don't forget: the more detailed the prompt, the better the image gets. You can even ask for text within the images you create.

GPT-4 Turbo: A Leap Forward in Generative AI

Public Preview Coming at the End of November 2023

Prepare for a transformative leap with the upcoming public preview of GPT-4 Turbo. This model offers lower pricing, extended prompt length, and structured JSON formatting, delivering improved efficiency and control.

Azure AI Studio

Public Preview

We are happy to introduce Azure AI Studio, Microsoft's new platform for AI developers. It combines pre-built AI services, machine learning models, content safety features, and responsible AI tools for privacy and security. This accelerates organizations from idea to impact, whether you're creating a custom copilot, improving search, enhancing call centers, developing bots, or a mix of these use cases. And it's an accessible platform, which you have to love!

GPT-3.5 Turbo 16k – 1106 : General Availability on the Horizon

GA Coming at the End of November 2023

The highly anticipated GPT-3.5 Turbo 16k – 1106 is nearing general availability, bringing enhanced capabilities and performance to Azure OpenAI Service. This marks another milestone in our commitment to providing state-of-the-art generative AI to developers worldwide.

Assistants API: Shaping Intelligent Experiences

In Preview, Coming Soon

The Assistants API, including capabilities such as Code Interpreter and Retrieval, is set to enter preview soon in Azure OpenAI Service. This powerful tool simplifies the creation of agent-like experiences within applications, offering developers a versatile and efficient solution for building intelligent interfaces.

Get Critical Insights into your Usage and Performance with an Improved Monitoring Experience

We are launching improved monitoring and observability capabilities for Azure OpenAI Service on the Azure Portal. With Azure OpenAI’s out-of-the-box metrics dashboard, customers can get a bird’s eye view of the most important usage and performance metrics for Azure OpenAI Service within seconds. You can understand the usage trends for your resource by breaking down API requests by model name, model version, deployment, operation and stream type (streaming or non-streaming), view error rates, latency, and utilization, among others. To get started, select your Azure OpenAI resource on Azure Portal, click on ‘Overview’ on the left pane and select ‘Monitoring’ on the right pane.

In addition, we are launching an enhanced metrics stack on Azure Monitor for Provisioned Throughput customers. As token costs vary significantly from model to model, we are launching ‘Active Tokens’ as an enhanced measure of your token utilization for provisioned deployments. Provisioned-managed customers can also understand the utilization % for their deployment and act when their calls are throttled when utilization exceeds 100%. Starting 11/27, customers will have a way to understand the latency of their streaming requests through the ‘Time to Response’ metric, which measures the time taken for the first response to appear after you have sent a response, excluding any client-side latency. Apart from the out-of-the-box dashboard, we have enhanced our Diagnostics Logs experience by adding deployment, model and response/request related schema to give you more granular visibility into your service usage.

Azure AI Advantage: Elevating Your AI-Powered Applications

If you're innovating with AI, build and modernize your applications on Azure. Azure offers a full, integrated stack purpose-built for AI-powered applications, giving you a competitive edge and superior performance. With pioneering AI technology, a deeply integrated platform, and leading cloud security, Azure is your partner for delivering next-gen, transformative experiences. For a limited time, get a free trial of Azure Cosmos DB when using Azure AI Services, including Azure OpenAI Service, and GitHub Copilot. Plus, we offer funding to get started implementing your new AI application. Learn more about the Azure AI Advantage offer.

Copyright Commitment: Defending Your Innovation

In September, we announced the Copilot Copyright Commitment, a new benefit to defend all commercial customers from copyright claims. Today, we're excited to announce that Microsoft is broadening that commitment to include the Azure OpenAI Service. The new benefit, the Customer Copyright Commitment, helps customers accelerate their external use of generative AI. To take advantage of the new benefit, customers need to implement technical measures to mitigate the risk of infringing output, and Microsoft is pleased to share that we are publishing new documentation during Ignite to help our customers implement these measures and build with confidence.

Customer Success Stories

We are inspired by our customers and partners around the world using generative AI to advance industry innovation and help people thrive. Here are a few success stories. Providence utilizes Azure OpenAI Service to mitigate clinician burnout and streamline patient care, while KRY is revolutionizing the way patients access healthcare, reducing administrative burdens for clinicians, widening limited healthcare resources, and ultimately, improving the overall quality of patient care. Azure OpenAI Service also plays a crucial role at HEINEKEN, where it connects employees with information across the company using Azure AI services. Lucy® the Answer Engine® extends its knowledge and capabilities with the seamless integration of Azure. Furthermore, in manufacturing, Sight Machine collaborates with Azure to empower manufacturers in enhancing production performance through the utilization of industrial data and generative AI. UiPath is automating unit testing for developers and streamlining copy-paste actions to drive automation, Cube RM is achieving unprecedented efficiency in tender management through an AI-based solution and Dotdigital is harnessing the innovative power of Microsoft’s Responsible AI within Azure to enhance creativity and engagement for marketers.

The Road Ahead

The future of generative AI is unfolding before us. With these groundbreaking additions to Azure OpenAI Service, coupled with our commitment to customer copyright protection, content safety, and the capabilities of Azure AI Studio, we invite developers to embark on a journey of limitless creativity and innovation.

Let's re~~define~~prompt what is possible in the world of generative AI.

Resources