Server 2016/2019 Crash after Win Update

%3CLINGO-SUB%20id%3D%22lingo-sub-2412148%22%20slang%3D%22en-US%22%3EServer%202016%2F2019%20Crash%20after%20Win%20Update%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2412148%22%20slang%3D%22en-US%22%3E%3CP%3EHey%20%3A)%3C%2Fimg%3E%3CBR%20%2F%3E%3CBR%20%2F%3ESo%20we%20started%20to%20got%20this%26nbsp%3Bstrange%20problem%20after%26nbsp%3BJanuary%20Patch%20Tuesday%2C%20our%202016%20server%20will%20randomly%20crash%20when%26nbsp%3Bapplying%20the%20new%20opdates.%3CBR%20%2F%3EIt%20has%20happen%20at%20every%20Patch%20Tuesday%20since%2C%20and%20totaly%20random.%20Different%20server%20crash%20every%20patch%20tuesday.%3CBR%20%2F%3EIt%20could%20be%20the%20same%20server%20og%20new%20server%20that%20crash%20after%20Patch%20Tuesday.%20No%20server%20have%20crash%20on%20all%20patch%20tuesday%2C%20but%20in%20totalt%20we%20have%2035-40%20differnt%20servers%20that%20have%20crashed%20out%20off%20100%20total%202016%20with%20the%20specs%20down%20below.%3CBR%20%2F%3EI%20have%20restored%20a%20server%20from%20backup%2C%20and%20when%20i%20try%20to%20update%20it%2C%20it%20can%20crash%20after%20first%20try%20or%20after%205%20times.%20It's%20random%20if%20it%20crash%20or%20not.%3CBR%20%2F%3E%3CBR%20%2F%3E%3CSTRONG%3ECrash%20Info%3A%3CBR%20%2F%3E%3C%2FSTRONG%3E%3C%2FP%3E%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22Mads-Ejnar_0-1622720571476.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F285920i424416AC9D9ACC71%2Fimage-size%2Fmedium%3Fv%3Dv2%26amp%3Bpx%3D400%22%20role%3D%22button%22%20title%3D%22Mads-Ejnar_0-1622720571476.png%22%20alt%3D%22Mads-Ejnar_0-1622720571476.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EThe%20Server%20goes%20into%20BSOD%20and%20don't%20start.%3CBR%20%2F%3EMost%20time%20the%20server%20will%20start%20after%20a%20manuel%20restart%2C%20a%20few%20times%20we%20had%20to%20restore%20the%20server%20from%20the%20day%20before.%3CBR%20%2F%3E%3CBR%20%2F%3E%3CSTRONG%3EThe%20only%20server%20we%20have%20this%20problem%20on%20is%3A%3C%2FSTRONG%3E%3CBR%20%2F%3EWindows%20Server%202016%20%2F%202019%3CBR%20%2F%3E1%20Core%20(E5-2690%20v4%20or%26nbsp%3BGold%206132)%3CBR%20%2F%3E%3CBR%20%2F%3EAll%20other%20server%20do%20not%20crash%2C%20if%20they%20got%202%20or%20more%20cores.%3CBR%20%2F%3E%3CBR%20%2F%3EAll%20Server%20are%20VM's%20in%20VMware%20on%20ESXI%206.7%20build%3A%2017700523%20-%20EVC%3A%20Intel%20Broadwell%3CBR%20%2F%3EVMware%20Tools%20Version%2011.2.0%20and%2011.2.5%20are%20running%20on%20the%20servers.%3CBR%20%2F%3E%3CBR%20%2F%3E%3CSTRONG%3EEveryting%20i%20have%20tried%20so%20far%2C%20but%20the%20problem%20is%20still%20there.%3C%2FSTRONG%3E%3CBR%20%2F%3E-SFC%20Scan%20and%20Dism%3CBR%20%2F%3E-Tried%20remove%20Anti-Virus%20software%20on%20server%20we%20installed%20back%20in%20December%20(F-Secure%2015)%3CBR%20%2F%3E-Tried%20remove%20.Net%204.8%20that%20was%20installed%20along%20F-Secure%3CBR%20%2F%3E-Tried%20remove%20VMware%20Tools%20%2F%20downgrade.%20Was%20upgraded%20to%2011.2.0%20back%20in%20December%3CBR%20%2F%3E-Tried%20upgrade%20Hardware%20Version%20on%20the%20VM%20from%2010%20to%2015.%20Know%20this%20should%20not%20do%20anything%2C%20but%20tried%20anyway.%3CBR%20%2F%3E-Tried%20Reset%20firewall%20settings%3CBR%20%2F%3E-Tried%20Disable%20IPv6%3CBR%20%2F%3E%3CBR%20%2F%3EAlso%20tried%20alot%20of%20combination%20of%20all%20of%20them.%20But%20nothing.%3CBR%20%2F%3E%3CBR%20%2F%3E%3CSTRONG%3EWhat%20fixed%20the%20problem%20so%20far%2C%20but%20not%20a%20solution%3C%2FSTRONG%3E%3CBR%20%2F%3E-Add%20more%20hardware.%20If%20they%20have%202%20cores%20or%20more.%3CBR%20%2F%3EBut%20that's%20no%20a%20great%26nbsp%3Bsolution%20because%20we%20are%20a%20hosting%20site%20and%20end%20user%20pay%20for%20the%20hardware%20in%20the%20server%2C%20so%26nbsp%3Beither%20the%20end%20user%20have%20to%20pay%20more%2C%20or%20we%20should%20give%20it%20for%20free.%3CBR%20%2F%3E-Disconnect%20the%20network%20when%20restarting%20the%20server.%3CBR%20%2F%3E-Disable%20Firewall%3CBR%20%2F%3E%3CBR%20%2F%3E%3CBR%20%2F%3ESo%20now%20om%20not%20sure%20what%20to%20try%20and%20what%20could%20be%20the%20problem.%3CBR%20%2F%3EI%20think%20there%20is%20a%20performens%20problem%20some%20where%2C%20since%20that%20serveres%20with%20more%20hardware%20don't%20have%20the%20problem.%20But%20can%20be%20totaly%20wrong.%26nbsp%3B%3CBR%20%2F%3EIf%20there%20is%20a%26nbsp%3Bcorrupt%20fil%2C%20should%20it%20not%20crash%20every%20time%20and%20not%20at%20random%3F%3CBR%20%2F%3E%3CBR%20%2F%3EDo%20any%20of%20you%20have%20an%20idea%20on%20what's%20to%20try%20next%3F%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-2412148%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EWindows%20Server%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Frequent Visitor

Hey :)

So we started to got this strange problem after January Patch Tuesday, our 2016 server will randomly crash when applying the new opdates.
It has happen at every Patch Tuesday since, and totaly random. Different server crash every patch tuesday.
It could be the same server og new server that crash after Patch Tuesday. No server have crash on all patch tuesday, but in totalt we have 35-40 differnt servers that have crashed out off 100 total 2016 with the specs down below.
I have restored a server from backup, and when i try to update it, it can crash after first try or after 5 times. It's random if it crash or not.

Crash Info:

Mads-Ejnar_0-1622720571476.png

 

The Server goes into BSOD and don't start.
Most time the server will start after a manuel restart, a few times we had to restore the server from the day before.

The only server we have this problem on is:
Windows Server 2016 / 2019
1 Core (E5-2690 v4 or Gold 6132)

All other server do not crash, if they got 2 or more cores.

All Server are VM's in VMware on ESXI 6.7 build: 17700523 - EVC: Intel Broadwell
VMware Tools Version 11.2.0 and 11.2.5 are running on the servers.

Everyting i have tried so far, but the problem is still there.
-SFC Scan and Dism
-Tried remove Anti-Virus software on server we installed back in December (F-Secure 15)
-Tried remove .Net 4.8 that was installed along F-Secure
-Tried remove VMware Tools / downgrade. Was upgraded to 11.2.0 back in December
-Tried upgrade Hardware Version on the VM from 10 to 15. Know this should not do anything, but tried anyway.
-Tried Reset firewall settings
-Tried Disable IPv6
-Tried Regsvr32

Also tried alot of combination of all of them. But nothing.

What fixed the problem so far, but not a solution
-Add more hardware. If they have 2 cores or more.
But that's no a great solution because we are a hosting site and end user pay for the hardware in the server, so either the end user have to pay more, or we should give it for free.
-Disconnect the network when restarting the server.
-Disable Firewall


So now om not sure what to try and what could be the problem.
I think there is a performens problem some where, since that serveres with more hardware don't have the problem. But can be totaly wrong. 
If there is a corrupt fil, should it not crash every time and not at random?

Do any of you have an idea on what's to try next?

 

0 Replies