On Your Data is now Generally Available in Azure OpenAI Service

We're thrilled to announce the much-anticipated Azure OpenAI Service On Your Data is now generally available! The groundbreaking feature empowers you to leverage the power of OpenAI models, such as GPT-4, and incorporates the advanced capabilities of RAG (Retrieval Augmented Generation) model, directly on your data with enterprise-grade security on Azure. This cutting-edge capability transforms the way you connect, interact, and ground your data, with greater accuracy and speed through a user-friendly conversational experience. You can rapidly create personalized copilots with your data to enhance user comprehension, expedite task completion, and aid decision-making.

Unleashing the Power of Your Data 

Azure OpenAI Service On Your Data empowers you to unlock the full potential of your data effortlessly with enterprise-grade security. By directly running OpenAI models on your data, the requirement for extensive training is eliminated. Leveraging advanced AI capabilities such as GPT-4 allows you to streamline communication, enhance customer service, and increase productivity throughout your organization.

With Azure OpenAI Service On Your Data, you can achieve superior quality AI responses out-of-the-box as we have implemented precision prompt engineering and tuned various components such as intent extraction, search retrieval, filtering and re-ranking, data ingestion to deliver accurate, concise, and coherent responses optimized for each model.

Build a Copilot with the On Your Data feature

Capabilities Generally Available

Below is a range of general availability capabilities:

• Enhanced Security for Enterprise: Access your private Azure resources on both Azure OpenAI Studio and APIs with private endpoints and VPN enabled for Azure AI Search, Azure OpenAI, and Azure Blob Storage (preview). With document-level access control, responses can be generated based on the documents a user can access.
• Expanded Data Sources: Connect to your data from Azure AI Search and Azure Cosmos DB for MongoDB vCore, as well as the data sources in preview, including Azure Blob Storage, local files, URL/web address, etc. Stay tuned for more additions to the general availability list.
• Incorporate RAG (Retrieval-Augmented Generation) for Intelligent Information Retrieval: Utilize the advanced capabilities of the RAG model to enhance the quality and relevance of information retrieval, enabling more context-aware and precise responses in your conversational experiences.
• Customizable Responses and Parameters: Tailor your chat experience by limiting response and custom parameters, such as the strictness and number of documents retrieved.
• Azure AI Vector and Hybrid Search: Achieve more precise data retrieval with vector or hybrid search  from Azure AI Search, refining the insights you gather from your data.
• Semantic ranker enabled as a Default: Enjoy re-ranked, prioritized results with semantic ranker from Azure AI Search, enabled by default.
• OpenAI Models Availability: Get access to OpenAI GPT-35-Turbo, GPT-35-Turbo-16k, GPT-4, GPT-4-32k models.
• Private Endpoints & VPNs:
• Document-level Access Control: Boost security by limiting access to documents based on Microsoft Entra ID when generating responses.
• Effortless and Swift Deployment: Seamless and rapid deployment to a web application or a copilot in the Copilot Studio (preview).
• Search Filter (API): Customize your searches and add context with the retrieval augmented generation (RAG) model on specific parts of our API.
• Updated SDK: Streamline integration with your systems using our improved SDK, harnessing the power of Azure OpenAI On Your Data.
• Supported File Types: .txt., .pdf, .docx, .pptx, .md, .html

Customer Use Cases and Benefits

Azure OpenAI Service On Your Data offers multiple customer benefits. It boosts productivity in both B2C and B2B interactions, enables data analysis for insights and industry knowledge, and positively influences productivity, cost savings, and decision-making. This can contribute to your business thriving in today's dynamic market.

Customer Inspiration

Built on Azure OpenAI Service, Young Williams' Priya bot transforms customer service and case management within government agencies. Priya provides round-the-clock assistance, addressing inquiries with realism and empathy, effectively reduces the burden on busy call centers while maintaining seamless human-like interaction. Try Priya firsthand.

“I'm thrilled about the partnerships we have with multiple states where we leveraged the On Your Data feature of Azure OpenAI Service. The Priya bot is changing how public agencies serve citizens, offering round-the-clock, empathetic assistance and easing call center loads. This collaboration highlights the impact of generative AI in improving government responsiveness and efficiency. We're excited to keep pushing the boundaries of public service innovation.” – Rob Wells, CEO of Young Williams

Priya by Young Williams for the State of Louisiana

Kick-start Your Journey with Azure OpenAI Service On Your Data

Begin your venture with Azure OpenAI Service On Your Data - a groundbreaking technology designed to revolutionize how you connect and interact with your enterprise data. Transition your data insights into a powerful lever to boost your business performance. Utilize the compelling force of conversational AI with Azure OpenAI Service. Join us in this journey and start experiencing the transformative benefits for your business today.

Resources

• Documentation for Azure OpenAI Service On Your Data
• QuickStart (API, SDK, Azure OpenAI Studio)
• Apply for access to Azure OpenAI Service