Forum Discussion

Karl-WE's avatar
Karl-WE
MVP
May 12, 2023

Azure Stack HCI - performance degradation over time

Dear Community, dear DanCuomo,

is there any awareness about the following potential problem with Azure Stack HCI OS 22H2?
Hope to find some echo.

Problem description:

severe Storage NVMe performances degradation over time.

Restarting the nodes will remediate the situation.

I have heard about an issue that, customer, and partner claim this to be "long standing and a known issue".  Also claim there was no solution offered by MSFT support.

I got informed about this, and customer agreed to back his claims with futher data, hopefully also with Microsoft SRs involved. 

Azure Stack HCI

3 Replies

Sort By
  • Darryl van der Peijl's avatar
    Darryl van der Peijl
    MVP
    May 15, 2023

    Hi Karl-WE,


    Lets first be clear where you see the degradation, is this inside the VM or do you see latency counters go up on the physical disk side?

    There is a long standing and known issue when using CBT and particular backup software. A live migration of the virtual machine typically solves the issue. This issue is caused inside the VM, you won't see any latency or errors on physical disk level.

     

     

    --
    Darryl van der Peijl
    Splitbrain

    • Karl-WE's avatar
      Karl-WE
      MVP
      May 22, 2023

      Dear Darryl van der Peijl thank you for taking the time to reply.

      Quite unfortunately the customer in question didn't provide any further detail, as they agreed to do so. 

      Could you name some solutions causing this like CommVault, Veeam B&R or Macrium Reflect ? Are they all affected? So as a remedediation live migrate the VM after the backup with a post backup task or disabling CBT? 

       

      DanCuomo cheers, I will do so once I receive more information on the matter.

       

Resources