More Questions about MMPT remote packaging

%3CLINGO-SUB%20id%3D%22lingo-sub-2647032%22%20slang%3D%22en-US%22%3EMore%20Questions%20about%20MMPT%20remote%20packaging%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2647032%22%20slang%3D%22en-US%22%3E%3CP%3EThe%20powershell%20code%20in%20the%20MSIX%20Toolkit%20%22Batch%20Conversion%22%20seems%20to%20imply%20that%20a%20controller%20may%20work%20with%20many%20different%20worker%20VMs%20in%20parallel.%20Each%20parallel%20thread%20would%20invoke%20a%20separate%20instance%20of%20the%20local%20MMPT%20to%20work%20with%20a%20counter-part%20on%20a%20different%20remote%20VM.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EI%20wanted%20to%20ask%20if%20the%20MMPT%20is%20truly%20multi-threaded%20to%20support%20this.%26nbsp%3B%20While%20my%20testing%20shows%20OK%20results%20for%20a%20couple%20of%20worker%20VMs%2C%20expanding%20beyond%20that%20seems%20to%20cause%20unexpected%20(and%20inconsistent)%20failures.%26nbsp%3B%20Of%20course%20there%20is%20always%20the%20possibility%20of%20resource%20exhaustion%20occurring%20at%20some%20point%20in%20the%20chain%2C%20but%20I%20wanted%20to%20be%20sure%20that%20this%20is%20a%20supported%20scenario.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EI%20want%20to%20package%20up%20a%20very%20large%20group%20of%20apps%20and%20want%20to%20utilize%208%20worker%20VMs%20(spread%20out%20on%20different%20Hyper-V%20hosts).%26nbsp%3B%20My%20modified%20scripts%20work%20OK%20on%20two%20workers%2C%20but%20going%20above%203%20seems%20an%20issue.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-2667339%22%20slang%3D%22en-US%22%3ERe%3A%20More%20Questions%20about%20MMPT%20remote%20packaging%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2667339%22%20slang%3D%22en-US%22%3EHi%20Tim%2C%20%3CBR%20%2F%3E%3CBR%20%2F%3EThanks%20for%20asking.%20This%20is%20an%20intended%20use%20case%20for%20the%20MSIX%20Packaging%20Tool%20remote%20packaging.%20I'd%20like%20to%20learn%20more%20about%20the%20failures%20you%20are%20experiencing.%20We%20will%20do%20some%20of%20our%20own%20testing%20as%20well%2C%20but%20its%20always%20helpful%20to%20get%20a%20variety%20of%20testing%20when%20trying%20to%20determine%20issues.%20%3CBR%20%2F%3E%3CBR%20%2F%3EBest%2C%3CBR%20%2F%3ESharla%3C%2FLINGO-BODY%3E
MVP

The powershell code in the MSIX Toolkit "Batch Conversion" seems to imply that a controller may work with many different worker VMs in parallel. Each parallel thread would invoke a separate instance of the local MMPT to work with a counter-part on a different remote VM.

 

I wanted to ask if the MMPT is truly multi-threaded to support this.  While my testing shows OK results for a couple of worker VMs, expanding beyond that seems to cause unexpected (and inconsistent) failures.  Of course there is always the possibility of resource exhaustion occurring at some point in the chain, but I wanted to be sure that this is a supported scenario.

 

I want to package up a very large group of apps and want to utilize 8 worker VMs (spread out on different Hyper-V hosts).  My modified scripts work OK on two workers, but going above 3 seems an issue.

4 Replies
Hi Tim,

Thanks for asking. This is an intended use case for the MSIX Packaging Tool remote packaging. I'd like to learn more about the failures you are experiencing. We will do some of our own testing as well, but its always helpful to get a variety of testing when trying to determine issues.

Best,
Sharla

@Sharla_Akers 

Thanks for the confirmation.
I am attaching an of the example failure log files. If I rerun the exact same scenario, some of these will work and others fail instead. The failures tend to appear in two places:

  1. After copying files to the VM, remote execution fails (see AdobeReader example). Both controller and worker VMs, as well as Hyper-V host are domain joined and time sync properly. Sometimes the next attempt on this VM is OK, but at other times that VM will continue to fail on all subsequent passes (reverting to the "known good" snapshot) and I must manually revert the VM, log in and then I can start the automation script over and it is OK.
  2. After completing the package a similar issue occurs between the file getting saved and the copy back.

 

Even when this condition exists, I am able to log into the problematic VM remotely or run remote PowerShell commands to it manually, so even if this is an environmental issue, the packaging tool seems to be more sensitive to it.

 

I have since checked out the environment further and found that one of the AD controllers seems to have had an issue with Patch Tuesday updates.  This is being repaired and I'll rerun the tests to see if it solved the issue.

@Sharla_Akers  Here is that example log file.

@Sharla_Akers I have some progress to report.

  • Fixing the AD controller made no difference (but a good thing to do).
  • There was high CPU on VMs after reverting to the snapshot.  This was traced to windows defender. I neutered defender which helped with the issue in the previously attached log file.
  • There was an additional timing issue with my scripting.  At the end of a session I was shutting down the VM (Stop-VM) and sometimes it took too long to shutdown.  Changing that to a full stop (-TurnOff option added) kept the VM from getting in the way of the next pass.

 

I am now running with three worker VMs without issue and will soon try to expand to more.