Azure announces new AI optimized VM series featuring AMD’s flagship MI300X GPU
In our relentless pursuit of pushing the boundaries of artificial intelligence, we understand that cutting-edge infrastructure and expertise is needed to harness the full potential of advanced AI. At Microsoft, we've amassed a decade of experience in supercomputing and have consistently supported the most demanding AI training and generative inferencing workloads. Today, we're excited to announce the latest milestone in our journey. We’ve created a virtual machine (VM) with an unprecedented 1.5 TB of high bandwidth memory (HBM) that leverages the power of AMD’s flagship MI300X GPU. Our Azure VMs powered with the MI300X GPU give customers even more choices for AI optimized VMs.
Azure Windows Virtual Machine Activation: two new KMS IP addresses (…and why you should care)
This blog contains important information about KMS IP addresses changes that may impact Windows Virtual machine activations for Azure Global Cloud customers who configured custom routes or firewall rules to allow KMS IP addresses. Who will be affected? In July 2022, we announced two new KMS IP addresses, 20.118.99.224 and 40.83.235.53, in Azure Global Cloud via Azure Update - Generally available: New KMS DNS in Azure Global Cloud. We expect that most Azure Windows Virtual Machine customers will not be impacted. However, Azure Global Cloud customers who have followed troubleshooting guides, like the ones listed below, to configure custom routes or firewall rules that allow Windows VMs to reach KMS IP address in the past, must take actions to include these two new KMS IP addresses, 20.118.99.224 and 40.83.235.53. Otherwise, after October 3rd, 2022, your Windows Virtual Machines will report warnings of failing to reach Windows Licensing Servers for activation. https://docs.microsoft.com/en-us/troubleshoot/azure/virtual-machines/custom-routes-enable-kms-activation https://docs.microsoft.com/en-us/troubleshoot/azure/virtual-machines/troubleshoot-activation-problems https://docs.microsoft.com/en-us/azure/firewall/protect-azure-virtual-desktop How will customers be affected? As explained in Generally available: New KMS DNS in Azure Global Cloud, most Windows Virtual Machines in Global Cloud rely on new azkms.core.windows.net for Windows Activation. The new azkms.core.windows.net is currently pointing to kms.core.windows.net. After October 3 rd , 2022, azkms.core.windows.net will point to two new IP addresses 20.118.99.224 and 40.83.235.53. For customers who follow https://docs.microsoft.com/en-us/troubleshoot/azure/virtual-machines/custom-routes-enable-kms-activation, without taking the actions to include these two new IP addresses 20.118.99.224 and 40.83.235.53 in custom routes, your Windows Virtual Machines will not be able to connect to new KMS server for Windows Activation. For customers who follow https://docs.microsoft.com/en-us/azure/firewall/protect-azure-virtual-desktop, without taking the actions to include these two new IP addresses 20.118.99.224 and 40.83.235.53 in firewall rules, your Windows Virtual Machines will not be able to connect to new KMS server for Windows Activation. When failing to connect to KMS server for activation, Azure Windows Virtual Machines report warnings like the following - “We can't activate Windows on this device as we can't connect to your organization's activation server. Make sure you're connected to your organization's network and try again. If you continue having problems with activation, contact your organization's support person. Error code: 0xC004F074.” As explained in Key Management Services (KMS) activation planning, “KMS activations are valid for 180 days, a period known as the activation validity interval. KMS clients must renew their activation by connecting to the KMS host at least once every 180 days to stay activated. By default, KMS client computers attempt to renew their activation every seven days. After a client's activation is renewed, the activation validity interval begins again”. Within the 180-day KMS activate validity interval, customers can still access the full functionality of the Windows virtual machine. Customers should fix activation issues during the 180-day KMS activation validity interval. Action required To customers who follow https://docs.microsoft.com/en-us/troubleshoot/azure/virtual-machines/custom-routes-enable-kms-activation, include these two new IP addresses 20.118.99.224 and 40.83.235.53 in custom routes before October 3 rd , 2022. To customers who follow https://docs.microsoft.com/en-us/azure/firewall/protect-azure-virtual-desktop, include these two new IP addresses 20.118.99.224 and 40.83.235.53 in firewall rules before October 3 rd , 2022. How to check You can remote login to your Windows Virtual Machines and complete the following: Open PowerShell. Run the following command to confirm the connectivity to new KMS IP addresses: test-netconnection azkms.core.windows.net -port 1688 test-netconnection 20.118.99.224 -port 1688 test-netconnection 40.83.235.53 -port 1688 If the connections are successful, no more action is needed. If the connection(s) fails, you need to go to the “Action required” section. Important timeline After October 3 rd , 2022, most Azure Windows Virtual Machines will rely on two new KMS IP addresses 20.118.99.224 and 40.83.235.53 for Windows Activation, when azkms.core.windows.net points to these two new IP addresses. After March 1 st , 2023, all Azure Windows Virtual Machines will rely on two new KMS IP addresses 20.118.99.224 and 40.83.235.53 for Windows Activation, when kms.core.windows.net points to 20.118.99.224.Announcing the preview of new Azure VMs based on the Azure Cobalt 100 processor
Today, Microsoft is announcing the preview of the new Azure Virtual Machines (VMs) featuring the Azure Cobalt 100 Arm-based processor. The Cobalt 100 processor is based on the Neoverse N-series (N2) Arm CPU design, which is optimized for the performance of scale out cloud-based applications. The preview includes the general purpose (Dpsv6-series and Dplsv6-series) and memory optimized (Epsv6-series) VM series. To request access to preview, please fill out this form. The new Dpsv6 and Dpdsv6 general purpose VMs are engineered to efficiently run scale-out workloads and cloud native computing solutions such as those running on Azure Kubernetes Service (AKS). These VMs are ideal for small to medium open-source databases, application servers and web servers. These VMs also excel with containerized applications and can be leveraged by Arm developers in CI/CD pipelines, development and test scenarios. The new Dplsv6 and Dpldsv6 VMs are ideal for media encoding, small databases, gaming servers, microservices and any workloads that do not require higher RAM per vCPU. Additionally, the Epsv6 and Epdsv6 memory-optimized VMs have higher memory per vCPU to meet the requirements of large databases, in-memory caching applications and data analytics workloads. All the new Cobalt 100 VMs enable customers to seamlessly run modern, dynamic, scalable applications. The Azure Cobalt 100 VMs can deliver up to 1.4x CPU performance, up to 1.5x performance on Java-based workloads and up to 2x performance on web servers, .NET applications and in-memory cache applications compared to previous generation Azure Arm-based VMs. These VMs support 4x local storage IOPS (with NVMe direct) and up to 1.5x network bandwidth compared to the previous generation Azure Arm-based VMs. You can select from a range of Azure virtual machines that meet the CPU performance and memory needs of your workloads. You can choose from three memory ratios for a given vCPU size, giving you the flexibility to select the configuration that works best for your workload. The new Dpsv6-series offers up to 96 vCPUs with 384 GiBs of RAM (4:1 memory-to-vCPU ratio). The new Dplsv6-series offers up to 96 vCPUs with 192 GiBs of RAM (2:1 memory-to-vCPU ratio). The new Epsv6-series offer up to 96 vCPUs with up to 672 GiBs of RAM (up to 8:1 memory-to-vCPU ratio) for more memory intensive workloads. All these VM series are available with and without a local disk so that customers can choose the option that best fits each workload. You can deploy these new VMs using existing methods including the Azure portal, SDKs, APIs, PowerShell, and the command-line interface (CLI). During the preview period, the VMs are available in the Central US, East US, East US 2, North Europe, Southeast Asia, West Europe, and West US 2 Azure regions. The number of regions will continue to expand in 2024 and beyond. Explore future regional availability options by visiting the Azure product availability page. During the preview, the new Azure Cobalt 100 VMs are available for free. However, your Azure subscription will be billed for fees and applicable taxes associated with use of other Azure resources and services, such as disk storage, used in the deployment of these preview VMs. The new virtual machines support all remote disk types such as Standard SSD, Standard HDD, Premium SSD and Ultra Disk storage. To learn more about various disk types and their regional availability, please refer to Azure managed disk type. Disk storage is billed separately from virtual machines. The new Azure Cobalt 100 VMs support a wide range of Linux OS distributions including Canonical Ubuntu, CentOS, Debian, Red Hat Enterprise Linux, SUSE Enterprise Linux, Alma Linux, Azure Linux (via AKS), Flatcar Linux and more. Client application developers can take advantage of Azure’s highly available, scalable, and secure platform to run cloud-based builds and test workflows. For Windows developers, Insider Preview of Windows 11 Pro and Enterprise are available for Azure Cobalt 100 VMs. Customers can access the full list of images in the Azure Marketplace. Microsoft has decades of experience with Arm-based technologies through collaborations with software and hardware partners. The preview of the Azure Cobalt 100 VMs continues to showcase Microsoft’s commitment to developing a vibrant Arm ecosystem to accelerate customer innovation and in helping customers build great solutions. Major developer platforms and languages, such as .NET, C++ and Java, provide native Arm support to take advantage of the benefits that this processor architecture brings. Microsoft continues to invest in optimizing these developer platforms and languages on Linux and Windows to leverage the capabilities of the latest Arm architecture. .NET 8 adds numerous optimizations for Arm and C++ similarly brings its share of Arm optimizations with the Visual Studio 17.8 release. Visual Studio 17.10 also introduces SQL Server Data Tools (SSDT) for the Arm native Visual Studio. For Java customers, the Microsoft Build of OpenJDK has been built with Arm compiler optimizations and has been certified on Linux and Windows on Arm architectures. GitHub Actions, GitHub's CI/CD workflow engine, is an integral part of many developers’ workflows, and is used to continuously build, test, and deploy apps. GitHub Actions is now available for Windows and Linux on Arm in 2 flavors – self-hosted runners that can be hosted on an Arm VM or Arm device, and GitHub hosted runners that is available in private beta with GA expected later this summer. Containers are a popular deployment target for many reasons - a streamlined development workflow, isolation and security, efficient resource utilization, portability, and reproducibility. Emphasizing its commitment to developer productivity, Docker is now investing in this area by ensuring that Docker Desktop runs natively on Windows on Arm. The rich ecosystem of applications and libraries, compiled natively to Windows on Arm, continues to grow. In addition to the Microsoft products and tools optimized for Arm64, developer and creator tools such as the Unity games editor, Blender, Docker, GIMP and important libraries such as Qt, are all on track to deliver Arm-native versions this year. Our customers have shared their perspective: "Ansys and Microsoft have a long history of collaboration, and we are excited to continue our joint work to advance semiconductor design via the Cobalt 100 chip and the power of Microsoft Azure," said John Lee, vice president and general manager of the semiconductor, electronics, and optics business unit at Ansys. "Through the combined strengths of Ansys simulation expertise and Microsoft's prowess in enabling EDA technologies, Cobalt 100-based solutions will empower designers to economically achieve optimal Power, Performance, and Area in their designs. Together, we will help propel the semiconductor industry into a new era of unparalleled efficiency and productivity.” “We’ve helped thousands of customers in EDA and Systems combine the performance and scalability of the cloud providing ease-of-use and instant access to our powerful computational software, which speeds time-to-market window for innovative designs. We are excited to work with Microsoft Azure on the new Arm-based Azure Cobalt 100 to provide our mutual customers with optimal performance as they tackle the ever-increasing demands of compute, memory capacity, and price performance for gigascale, advanced-node designs.” - Mahesh Turaga, VP of Cloud Business Development, Cadence. “At Elastic, we love working with the Microsoft teams, from silicon to models,” said Shay Banon, co-founder and chief technology officer at Elastic. “The rate of progress on the Azure team is impressive, and we are excited to collaborate with them to bring these benefits to our users as fast as possible.” “At MongoDB, we continuously explore cutting-edge technologies to enhance our solutions. We are currently evaluating Arm for its benefits and price performance, with promising results so far. We have also evaluated the Azure Cobalt 100 VM and are pleased with its capabilities, particularly in handling intensive workloads. We look forward to taking advantage of these advancements to provide best-in-class performance and even better experiences for our customers.” - Andrew Davidson, SVP, Products, MongoDB. "Semiconductor companies must balance the competing priorities of schedule, cost and performance as they develop their products in sustainable and efficient ways. An important aspect of doing this successfully is carefully matching software workloads with the appropriate computing platforms. The combination of Microsoft Azure Cobalt 100 Arm-based VMs with Siemens EDA software will provide our mutual customers with an excellent option to meet both their product development and corporate objectives. We continue to partner with Microsoft to create innovative solutions for the semiconductor industry.” - Craig Johnson, Vice President, Siemens EDA Cloud Solutions. “Snowflake, as an early adopter of Azure’s Arm technology, has successfully leveraged Arm-based VMs in Azure for our data warehouse workloads. We are now excited to elevate our performance further with Azure's Cobalt 100 VMs, anticipating significant enhancements in delivering superior customer experience.” - Gabe Bryant, Director of Engineering, Snowflake. “Teradata is thrilled to partner with Microsoft Azure, and their launch of the Cobalt 100 VMs. The density and efficiency benefits will further Teradata's existing price/performance advantage for AI and data-driven workloads, scaled on Teradata’s VantageCloud Lake offering” - Daniel Spurling, SVP, Product Management, Teradata. Here’s what our technology partners are saying: “Customized silicon plays a fundamental role in powering the AI-accelerated workloads of the future. This suite of Azure VMs, powered by the Neoverse CSS -based Azure Cobalt 100, marks a key milestone in our longstanding partnership with Microsoft to unlock new paths to performant, efficient computing and provides Azure users more choice and greater ability to innovate using the vast Arm software ecosystem.” -Dermot O’Driscoll, vice president of product solutions, Infrastructure Line of Business, Arm. “The adoption of Arm-based architectures on Microsoft Azure drives cost efficiency and significant performance enhancements. With the introduction of the Azure Cobalt 100 Arm-based VMs, we are excited that Ubuntu users will see up to a 40% increase in workload performance. Our collaboration with Microsoft ensures that users can fully capitalize on these advancements with Ubuntu and Ubuntu Pro, optimizing for diverse and demanding workloads including application servers, machine learning platforms, open-source databases, in-memory caches, and cloud-native applications on AKS. This collaboration underscores our dedication to providing robust and scalable solutions that advance the capabilities of developers and enterprises alike.” - Alexander Gallagher, Vice President of Public Cloud, Canonical. “Whether on Azure or in their own datacenter, Red Hat is committed to providing customers with the broadest possible choice in architectures across the hybrid cloud that best meet their unique business requirements. The Cobalt 100 Arm-based Azure VMs offer a new, powerful option for customers to potentially drive greater efficiencies and scale in their operations, and we look forward to exploring how we can best enable these Arm-based processors on Red Hat Enterprise Linux.” - Ronald Pacheco, senior director, Red Hat Enterprise Linux Product and Ecosystem Strategy, Red Hat. You can learn more about the new Azure Cobalt 100 VMs by visiting the specification pages: Dpsv6-series, Dpdsv6-series, Dplsv6-series, Dpldsv6-series, Epsv6-series, Epdsv6-series. Have any questions? Please reach us at Azure Support and our experts will be there to help you with your Azure journey. Additional resources: Sign-up form: Cobalt100-VM-Preview-Signup Demo: Cobalt 100 VM demo Related blogs: Arm Holdings Canonical ElasticVMSS, VMSS Flex, what are they? And what’s the differences?
Hello folks, I’ve been looking at ways to scale regular VM up and down without having to create a full VM template used by the existing VM Scale Set. And I wanted a way that did not force me to choose between Availability and Scalability. I found my saving grace with Virtual Machine Scale set with flexible orchestration (VMSS Flex for short)Announcing public preview of new burstable VMs - Bsv2, Basv2 and Bpsv2
We are pleased to announce the public preview of the latest versions of the CPU burstable B family of Azure Virtual Machines. The new additions to the B family consist of 3 new VM series - Bsv2, Basv2, and Bpsv2, each based on the Intel® Xeon® Platinum 8370C, AMD EPYC™ 7763v, and Ampere® Altra® Arm-based processors respectively.Introducing Virtual Machine restore points – a simpler way to protect Azure workloads
Virtual Machine restore point are now generally available. Customers and Azure partners who are looking to build business continuity and disaster recovery solutions can use VM restore points to capture app consistent and crash consistent backups natively on the Azure platform. This can then be used to restore disks and VMs during scenarios such as data loss, data corruption or disaster recovery.Performance considerations for large scale deep learning training on Azure NDv4 (A100) series
Modern DL training jobs require large Clusters of multi-GPUs with high floating-point performance connected with high bandwidth, low latency networks. The Azure NDv4 VM series is designed specifically for these types of workloads. We will be focusing on HPC+AI Clusters built with the ND96asr_v4 virtual machine type and providing specific optimization recommendations to get the best performance.
