Blog Post

AI - Machine Learning Blog
6 MIN READ

Introducing Mistral Large 2411: Transforming Industries with Cutting-Edge AI Capabilities

Sharmichock's avatar
Sharmichock
Icon for Microsoft rankMicrosoft
Dec 13, 2024

The Azure AI Foundry Model Catalog has been a game-changer for enterprises worldwide, enabling them to harness the power of state-of-the-art AI models tailored for their unique needs. Among the many success stories, companies like Mars Science & Diagnostics and Doctolib have shown how Azure AI models, particularly Mistral, are driving transformative outcomes in their industries. We are excited to announce the launch of Mistral Large 2411 on Azure AI Model Catalog. This advanced Large Language Model (LLM) sets a new benchmark in AI capabilities, offering unprecedented reasoning, knowledge, and coding performance.

 

Key Features of Mistral Large 2411

  1. Enhanced System Prompts: Provides more contextually relevant and dynamic responses tailored to enterprise needs.
  2. Improved Long-Context Performance: Processes up to 128K tokens, enabling superior handling of lengthy and complex inputs.
  3. Advanced Function Calling: Features native JSON outputting and agent-centric capabilities for seamless integrations.
  4. Multi-Lingual Support: Supports dozens of languages, including English, French, German, Spanish, Italian, Chinese, Japanese, Korean, and more.
  5. Proficiency in Coding: Trained on 80+ coding languages, including Python, Java, C++, JavaScript, and even niche languages like Fortran and Swift.
  6. State-of-the-Art Reasoning: Excels in mathematical and logical problem-solving, making it ideal for sophisticated tasks.

Why Upgrade to Mistral Large 2411?

With the launch of Mistral Large 2411, enterprises can:

  • Unlock superior accuracy and efficiency for tasks involving large and unstructured datasets.
  • Seamlessly integrate advanced AI capabilities with existing workflows using the model’s native function calling and JSON support.
  • Future-proof their AI initiatives with a model designed to scale across industries and use cases.

For existing users of Mistral Large, transitioning to Mistral Large 2411 ensures access to the latest advancements in AI while maintaining compatibility with Azure’s ecosystem. This proactive upgrade will enable organizations to stay ahead of the curve.

Driving Success with Mistral Models: Real-World Stories

Revolutionizing Veterinary Care with Mars Science & Diagnostics

Anyone who has ever held their pet in a veterinarian’s office, anxiously awaiting test results, knows the emotional toll of every passing moment. For Mars Science & Diagnostics, a division within Mars Petcare, the mission is clear: to improve health outcomes for pets and their families through cutting-edge technology.

Mars has leveraged the Azure AI Model Catalog and Mistral models to build its RapidRead solution, which enhances diagnostic capabilities in veterinary care. With a growing global shortage of veterinary-trained radiologists, RapidRead leverages Mistral’s AI capabilities to analyze radiological images, helping veterinarians diagnose conditions faster and more accurately.

"The Azure AI catalog provides access to a wide range of pre-built models such as Mistral to help restructure data and enhance our accuracy. We know it’s accurate because nothing goes into our production systems without being validated and signed off by radiologists," says Mark Parkinson, Senior Director of AI Development at Mars.

With RapidRead, Mars achieved:

  • A 38% boost in average precision, ensuring better diagnostic accuracy.
  • 96.9% precision on test sets, streamlining radiology workflows and enabling veterinarians to focus on complex cases.

These advancements have not only saved hundreds of pet lives but have also significantly reduced diagnostic wait times, allowing pets to return home to their families faster.

Enhancing Healthcare Efficiency with Doctolib

As one of Europe’s leading eHealth platforms, Doctolib is transforming patient care by integrating Mistral Large with Azure’s AI technologies. Their AI-powered consultation assistant transcribes and summarizes medical consultations in just 15 seconds, allowing practitioners to spend twice as much time with their patients.

"Our mission is to help health professionals spend more time looking their patients in the eye rather than at their computer screen," explains Arthur Talpaert, Lead Product Manager at Doctolib.

Doctolib’s solution, built with Mistral Large, has:

  • Reduced practitioners’ administrative workload.
  • Enhanced the quality of patient-practitioner interactions.
  • Maintained strict data privacy and compliance standards using Azure’s secure infrastructure.

These real-world examples highlight the immense potential of Mistral models to address industry-specific challenges and unlock new opportunities.

Get Started with Mistral Large 2411 on Azure AI

Prerequisites:

  1. If you don’t have an Azure subscription, get one here: https://azure.microsoft.com/en-us/pricing/purchase-options/pay-as-you-go
  2. Familiarize yourself with Azure AI Model Catalog
  3. Create an Azure  AI Foundry hub and project. Make sure you pick East US, West US3, South Central US, West US, North Central US, East US 2 or Sweden Central as the Azure region for the hub.

Create a deployment to obtain the inference API and key:

  1. Open the model card in the model catalog on Azure AI Foundry.
  2. Click on Deploy and select the Pay-as-you-go option.
  3. Subscribe to the Marketplace offer and deploy. You can also review the API pricing at this step.
  4. You should land on the deployment page that shows you the API and key in less than a minute. You can try out your prompts in the playground.

The prerequisites and deployment steps are explained in the product documentation. You can use the API and key with various clients. Check out the samples to get started.

Empower Your Organization with Mistral Large 2411

The launch of Mistral Large 2411 is not just about introducing a new model—it’s about empowering businesses to achieve more with AI. Whether you’re in healthcare, veterinary science, finance, or any other field, Mistral Large 2411 offers the tools you need to innovate and excel. Join the growing community of enterprises leveraging the Azure AI Foundry Model Catalog to drive transformative outcomes.

 

 

 

FAQ

  1. Do we have fine-tuning on Mistral Large 2411?

Finetuning of these models are not supported yet but coming soon. Stay tuned!!!

  1. What does it cost to use Mistral Large 2411 on Azure?

You are billed based on the number of prompt and completions tokens. You can review the pricing on the Mistral Large 2411 offer in the Azure Marketplace offer details tab when deploying the model. You can also find the pricing on the Azure Marketplace.

  1. Are the Mistral models' region specific on Azure?
  •  Mistral  modelsare available through MaaS as serverless API endpoints. 
  • These endpoints can be created in Azure AI Foundry projects or Azure Machine Learning workspaces. Cross-regional support for these endpoints is available in the following regions in the US: East US, West US3, South Central US, West US, North Central US, East US 2  
  1. Do I require GPU capacity quota in my Azure subscription to deploy Mistral Large 2411?
  • Mistral Large 2411 is available through MaaS as serverless API endpoints. You don’t require GPU capacity quota in your Azure subscription to deploy these models.

 

  1. Mistral Large 2411 is listed on the Azure Marketplace. Can I purchase and use these models directly from Azure Marketplace?
  • Azure Marketplace is our foundation for commercial transactions for models built on or built for Azure. The Azure Marketplace enables the purchasing and billing of Mistral models. However, model discoverability occurs in both Azure Marketplace and the Azure AI model catalog. Meaning you can search and find Mistral models in both the Azure Marketplace and Azure AI Model Catalog. 
  • If you search for Mistral Large 2411 in Azure Marketplace, you can subscribe to the offer before being redirected to the Azure AI Model Catalog in Azure AI Studio where you can complete subscribing and can deploy the model. 
  • If you search for Mistral Large 2411  in the Azure AI Foundry Model Catalog, you can subscribe and deploy the model from the Model Catalog without starting from the Azure Marketplace. The Azure Marketplace still tracks the underlying commerce flow. 

 

  1. Given that Mistral Large 2411 is billed through the Azure Marketplace, does it retire my Azure consumption commitment (aka MACC)?

Yes, Mistral Large 2411 is “Azure benefit eligible” Marketplace offers, which indicates MACC eligibility. Learn more about MACC here: https://learn.microsoft.com/en-us/marketplace/zure-consumption-commitment-benefit

  1. Is my inference data shared with Mistral?
  • No, Microsoft does not share the content of any inference request or response data with any model provider. 
  • Microsoft acts as the data processor for prompts and outputs sent to and generated by a model deployed for pay-as-you-go inferencing (MaaS). Microsoft doesn't share these prompts and outputs with the model provider, and Microsoft doesn't use these prompts and outputs to train or improve Microsoft's, the model providers, or any third party's models.  Read more on data, security and privacy for Models-as-a-Service.
  1. Are there rate limits for the Mistral models on Azure?  

Yes, Mistral models come with 200 K tokens per minute and 1 K requests per minute limit. Reach out to Azure customer support if this doesn’t suffice.

 

  1. Can I use MaaS models in any Azure subscription types?

Customers can use MaaS models in all Azure subsection types with a valid payment method, except for the CSP (Cloud Solution Provider) program. Free or trial Azure subscriptions are not supported.

 

 

Published Dec 13, 2024
Version 1.0
No CommentsBe the first to comment