Written by Jason Yi, PM on the Azure Edge & Platform team at Microsoft.
Introduction
As we introduce the new generation VMFleet, we also want to provide a quick how to guide to help you quic...
Updated Jun 27, 2022
Version 2.0
Blog Post
Hi Jason,
Thanks for this post. Really detailed.
I'm having some issues getting my "fleet" to execute a sweep. I have rebuilt my fleet about 10 times, each time with a new "gold" Server Core image.
All my VM's start perfectly when I execute start-vmfleet and then they get looping with with a PowerShell window reading "Launching C:\run\control.ps1 @ [Whatever date/time]" ("Paused" state if I understand the deployment correctly)
Regardless what I try then to get a sweep to execute like:
Start-FleetSweep -b 4 -t 8 -o 8 -w 0 -d 300 -p r
OR
$profile = Get-FleetProfileXml -Name "General" -Warmup 30 -Duration 60 -Cooldown 30 -WriteRatio 30 -BlockSize 8
Start-FleetResultRun -ProfileXml $profile
OR
Measure-FleetCoreWorkload
Nothing happens in the VM. They all just keep looping on the control.ps1. They never execute the run.ps1 or sweep.ps1.
I can confirm that the drive mapping to \\169.254.1.1 works and that I can browse the L: from the VM's.
I can't figure out why they are not executing the remaining steps as from looking at the control.ps1 its supposed to look for "new" files and then execute them; which is not happening.
VMFleet 2.0.0.1
Windows Server 2019 DC (3 node Dell R740xd HCI)
Windows Server Standard Core VM's (144 count)
Have also tried different hosts. They all have the same symptoms.
Any help?
Thanks
Jacques
Control window output:
PS C:\Windows\system32> Start-FleetSweep -b 4 -t 8 -o 8 -w 0 -d 300 -p r
--------------------
2021-11-05T08:25:52: RUN PARAMETERS
2021-11-05T08:25:52: o = 8
2021-11-05T08:25:52: d = 300
2021-11-05T08:25:52: AddSpec =
2021-11-05T08:25:52: p = r
2021-11-05T08:25:52: b = 4
2021-11-05T08:25:52: t = 8
2021-11-05T08:25:52: w = 0
2021-11-05T08:25:52: Cool = 30
2021-11-05T08:25:52: Warm = 60
2021-11-05T08:25:52: iops = $null
2021-11-05T08:25:53: START Go Epoch: 1
2021-11-05T08:25:53: CLEAR pause at Go
2021-11-05T08:25:53: SLEEP TO RUN CHECK (19,98 seconds)
2021-11-05T08:26:13: RUN CHECK Go Epoch: 1
2021-11-05T08:26:13: RUN CHECK 1 : 0/144 done (0,02s, total 0,02s)
2021-11-05T08:26:13: RUN CHECK PASS Go Epoch: 1
2021-11-05T08:26:13: SLEEP TO END (369,95 seconds)
2021-11-05T08:32:23: COMPLETION CHECK 1 : 0/144 done (0,02s, total 0,02s)
2021-11-05T08:32:25: COMPLETION CHECK 2 : 0/144 done (0,00s, total 2,02s)
2021-11-05T08:32:27: COMPLETION CHECK 3 : 0/144 done (0,02s, total 4,06s)
2021-11-05T08:32:29: COMPLETION CHECK 4 : 0/144 done (0,00s, total 6,08s)
2021-11-05T08:32:31: COMPLETION CHECK 5 : 0/144 done (0,03s, total 8,13s)
2021-11-05T08:32:33: COMPLETION CHECK 6 : 0/144 done (0,02s, total 10,16s)
2021-11-05T08:32:35: COMPLETION CHECK 7 : 0/144 done (0,02s, total 12,17s)
2021-11-05T08:32:37: COMPLETION CHECK 8 : 0/144 done (0,02s, total 14,20s)
2021-11-05T08:32:39: COMPLETION CHECK 9 : 0/144 done (0,00s, total 16,22s)
2021-11-05T08:32:41: COMPLETION CHECK 10 : 0/144 done (0,00s, total 18,24s)
2021-11-05T08:32:43: COMPLETION CHECK 11 : 0/144 done (0,02s, total 20,27s)
2021-11-05T08:32:45: COMPLETION CHECK 12 : 0/144 done (0,02s, total 22,30s)
2021-11-05T08:32:47: COMPLETION CHECK 13 : 0/144 done (0,02s, total 24,31s)
2021-11-05T08:32:49: COMPLETION CHECK 14 : 0/144 done (0,00s, total 26,33s)
2021-11-05T08:32:51: COMPLETION CHECK 15 : 0/144 done (0,00s, total 28,34s)
2021-11-05T08:32:53: COMPLETION CHECK 16 : 0/144 done (0,00s, total 30,36s)
2021-11-05T08:32:55: COMPLETION CHECK 17 : 0/144 done (0,00s, total 32,38s)
2021-11-05T08:32:57: COMPLETION CHECK 18 : 0/144 done (0,02s, total 34,41s)
2021-11-05T08:32:59: COMPLETION CHECK 19 : 0/144 done (0,00s, total 36,42s)
2021-11-05T08:33:01: COMPLETION CHECK 20 : 0/144 done (0,00s, total 38,45s)
2021-11-05T08:33:03: COMPLETION CHECK 21 : 0/144 done (0,00s, total 40,49s)
2021-11-05T08:33:05: COMPLETION CHECK 22 : 0/144 done (0,00s, total 42,50s)
2021-11-05T08:33:07: COMPLETION CHECK 23 : 0/144 done (0,02s, total 44,53s)
2021-11-05T08:33:09: COMPLETION CHECK 24 : 0/144 done (0,00s, total 46,55s)
2021-11-05T08:33:11: COMPLETION CHECK 25 : 0/144 done (0,00s, total 48,58s)
2021-11-05T08:33:13: COMPLETION CHECK 26 : 0/144 done (0,02s, total 50,61s)
2021-11-05T08:33:15: COMPLETION CHECK 27 : 0/144 done (0,02s, total 52,64s)
2021-11-05T08:33:17: COMPLETION CHECK 28 : 0/144 done (0,02s, total 54,66s)
2021-11-05T08:33:19: COMPLETION CHECK 29 : 0/144 done (0,02s, total 56,69s)
2021-11-05T08:33:21: COMPLETION CHECK 30 : 0/144 done (0,00s, total 58,71s)
2021-11-05T08:33:23: COMPLETION CHECK 31 : 0/144 done (0,02s, total 60,75s)
2021-11-05T08:33:25: COMPLETION CHECK 32 : 0/144 done (0,00s, total 62,77s)
2021-11-05T08:33:27: COMPLETION CHECK 33 : 0/144 done (0,02s, total 64,82s)
2021-11-05T08:33:29: COMPLETION CHECK 34 : 0/144 done (0,02s, total 66,85s)
2021-11-05T08:33:32: COMPLETION CHECK 35 : 0/144 done (0,02s, total 68,88s)
2021-11-05T08:33:34: COMPLETION CHECK 36 : 0/144 done (0,00s, total 70,89s)
2021-11-05T08:33:36: COMPLETION CHECK 37 : 0/144 done (0,02s, total 72,93s)
2021-11-05T08:33:38: COMPLETION CHECK 38 : 0/144 done (0,02s, total 74,96s)
2021-11-05T08:33:40: COMPLETION CHECK 39 : 0/144 done (0,00s, total 76,97s)
2021-11-05T08:33:42: COMPLETION CHECK 40 : 0/144 done (0,00s, total 78,99s)
2021-11-05T08:33:44: COMPLETION CHECK 41 : 0/144 done (0,02s, total 81,02s)
2021-11-05T08:33:46: COMPLETION CHECK 42 : 0/144 done (0,02s, total 83,05s)
2021-11-05T08:33:48: COMPLETION CHECK 43 : 0/144 done (0,00s, total 85,07s)
2021-11-05T08:33:50: COMPLETION CHECK 44 : 0/144 done (0,00s, total 87,10s)
2021-11-05T08:33:52: COMPLETION CHECK 45 : 0/144 done (0,02s, total 89,15s)
2021-11-05T08:33:54: COMPLETION CHECK 46 : 0/144 done (0,02s, total 91,16s)
2021-11-05T08:33:56: COMPLETION CHECK 47 : 0/144 done (0,00s, total 93,16s)
2021-11-05T08:33:58: COMPLETION CHECK 48 : 0/144 done (0,00s, total 95,19s)
2021-11-05T08:34:00: COMPLETION CHECK 49 : 0/144 done (0,00s, total 97,21s)
2021-11-05T08:34:02: COMPLETION CHECK 50 : 0/144 done (0,00s, total 99,24s)
2021-11-05T08:34:04: COMPLETION CHECK 51 : 0/144 done (0,00s, total 101,25s)
2021-11-05T08:34:06: COMPLETION CHECK 52 : 0/144 done (0,02s, total 103,30s)
2021-11-05T08:34:08: COMPLETION CHECK 53 : 0/144 done (0,02s, total 105,33s)
2021-11-05T08:34:10: COMPLETION CHECK 54 : 0/144 done (0,02s, total 107,35s)
2021-11-05T08:34:12: COMPLETION CHECK 55 : 0/144 done (0,02s, total 109,38s)
2021-11-05T08:34:14: COMPLETION CHECK 56 : 0/144 done (0,00s, total 111,40s)
2021-11-05T08:34:16: COMPLETION CHECK 57 : 0/144 done (0,00s, total 113,41s)
2021-11-05T08:34:18: COMPLETION CHECK 58 : 0/144 done (0,02s, total 115,46s)
2021-11-05T08:34:20: COMPLETION CHECK 59 : 0/144 done (0,00s, total 117,47s)
2021-11-05T08:34:22: COMPLETION CHECK 60 : 0/144 done (0,00s, total 119,49s)
2021-11-05T08:34:24: COMPLETION CHECK 61 : 0/144 done (0,00s, total 121,51s)
2021-11-05T08:34:24: ABORT: only received 0/144 completions in 61 attempts
Load did not fully complete, please check profile and virtual machines for errors
At C:\Program Files\WindowsPowerShell\Modules\VMFleet\2.0.0.1\VMFleet.psm1:4993 char:13
+ throw "Load did not fully complete, please check profile ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : OperationStopped: (Load did not fu...ines for errors:String) [], RuntimeException
+ FullyQualifiedErrorId : Load did not fully complete, please check profile and virtual machines for errors