Windows 2022 21H2 Cumulative Updates Failing

[flucas-SG330]

I have a Windows 2022 21H2 server that is a domain controller this has happened the last 2 months where the Windows CU do not install. They fail with error 0x800f0831.

The CU for .NET installs fine, but the Windows CUs fail every time with the same error. this happened on KB5031364 and on KB5030216. It is a newly build VM that I built a back in August of 2023. 

I've tried the Windows Update Troubleshooter, Disk Clean up, with and without our Anti-Virus software. BITS is Automatic (Delayed start) and Running, Windows Update is set to Automatic and running.

I've tried deleting the C:\Windows\SoftwareDistribution folder. I've also tried applying the CUs from Windows update and downloading them directly from the Windows Catalog download site.

Everytime I get the same result, failed 0x800f0831

[#2]

from the CBS log:
2023-10-11 11:09:06, Error CSI 00000364@2023/10/11:15:09:06.106 (F) onecore\base\wcp\componentstore\csd_locking.cpp(95): Error STATUS_SXS_ASSEMBLY_MISSING originated in function CCSDirectTransaction::LockComponent expression: (null)
[gle=0x80004005]
2023-10-11 11:09:06, Info CBS Added C:\Windows\Logs\CBS\CBS.log to WER report.
2023-10-11 11:09:06, Info CBS Added C:\Windows\Logs\CBS\CbsPersist_20231011145443.log to WER report.
2023-10-11 11:09:06, Info CBS Added C:\Windows\Logs\CBS\CbsPersist_20231011143233.log to WER report.
2023-10-11 11:09:06, Info CBS Added C:\Windows\Logs\CBS\CbsPersist_20231011135443.log to WER report.
2023-10-11 11:09:06, Info CBS Added C:\Windows\Logs\CBS\CbsPersist_20231011110224.cab to WER report.
2023-10-11 11:09:06, Info CBS Added C:\Windows\Logs\CBS\CbsPersist_20231011040224.cab to WER report.
2023-10-11 11:09:06, Info CBS Not able to add pending.xml to Windows Error Report. [HRESULT = 0x80070002 - ERROR_FILE_NOT_FOUND]
2023-10-11 11:09:06, Info CBS Not able to add pending.xml.bad to Windows Error Report. [HRESULT = 0x80070002 - ERROR_FILE_NOT_FOUND]
2023-10-11 11:09:06, Info CBS Not able to add SCM.EVM to Windows Error Report. [HRESULT = 0x80070002 - ERROR_FILE_NOT_FOUND]
2023-10-11 11:09:06, Error CSI 00000365 (F) STATUS_SXS_ASSEMBLY_MISSING #1507088# from CCSDirectTransaction::OperateEnding at index 0 of 1 operations, disposition 2[gle=0xd015000c]
2023-10-11 11:09:06, Error CSI 00000366 (F) HRESULT_FROM_WIN32(ERROR_SXS_ASSEMBLY_MISSING) #1506954# from Windows::ServicingAPI::CCSITransaction::ICSITransaction_PinDeployment(Flags = 0, a = Microsoft-Windows-ServerCore-CertificateServices-CA-Deployment-LanguagePack, version 10.0.20348.1, arch amd64, culture [l:5]'en-US', nonSxS, pkt {l:8 b:31bf3856ad364e35}, cb = (null), s = (null), rid = 'Microsoft-Windows-CredentialManagementRole~31bf3856ad364e35~amd64~en-US~10.0.20348.1.CertificateServices', rah = (null), manpath = (null), catpath =[gle=0x80073701]
2023-10-11 11:09:06, Error CSI (null), ed = 0, disp = 0)[gle=0x80073701]
2023-10-11 11:09:06, Info CBS Failed to pin deployment while resolving Update: Microsoft-Windows-CredentialManagementRole~31bf3856ad364e35~amd64~en-US~10.0.20348.1.CertificateServices from file: (null) [HRESULT = 0x80073701 - ERROR_SXS_ASSEMBLY_MISSING]
2023-10-11 11:09:06, Info CBS Failed to bulk stage deployment manifest and pin deployment for package:Microsoft-Windows-PowerShell-ISE-FOD-Package~31bf3856ad364e35~wow64~en-US~10.0.20348.1 [HRESULT = 0x80073701 - ERROR_SXS_ASSEMBLY_MISSING]
2023-10-11 11:09:06, Info CBS CommitPackagesState: Started persisting state of packages
2023-10-11 11:09:06, Info CBS CommitPackagesState: Completed persisting state of packages
2023-10-11 11:09:06, Info CSI 00000367@2023/10/11:15:09:06.831 CSI Transaction @0x1fe53a9f170 destroyed
2023-10-11 11:09:06, Info CBS Perf: Resolve chain complete.
2023-10-11 11:09:06, Info CBS Failed to resolve execution chain. [HRESULT = 0x80073701 - ERROR_SXS_ASSEMBLY_MISSING]
2023-10-11 11:09:06, Error CBS Failed to process single phase execution. [HRESULT = 0x80073701 - ERROR_SXS_ASSEMBLY_MISSING]
2023-10-11 11:09:06, Info CBS WER: Generating failure report for package: Package_for_ServicingStack_2032~31bf3856ad364e35~amd64~~20348.2032.1.1, status: 0x80073701, failure source: Resolve, start state: Installed, target state: Installed, client id: WindowsUpdateAgent
2023-10-11 11:09:06, Info CBS Not able to query DisableWerReporting flag. Assuming not set... [HRESULT = 0x80070002 - ERROR_FILE_NOT_FOUND]
2023-10-11 11:09:06, Info CBS Added C:\Windows\Logs\CBS\CBS.log to WER report.
2023-10-11 11:09:06, Info CBS Added C:\Windows\Logs\CBS\CbsPersist_20231011145443.log to WER report.
2023-10-11 11:09:06, Info CBS Added C:\Windows\Logs\CBS\CbsPersist_20231011143233.log to WER report.
2023-10-11 11:09:06, Info CBS Added C:\Windows\Logs\CBS\CbsPersist_20231011135443.log to WER report.
2023-10-11 11:09:06, Info CBS Added C:\Windows\Logs\CBS\CbsPersist_20231011110224.cab to WER report.
2023-10-11 11:09:06, Info CBS Added C:\Windows\Logs\CBS\CbsPersist_20231011040224.cab to WER report.
2023-10-11 11:09:06, Info CBS Not able to add %windir%\winsxs\pending.xml to WER report. [HRESULT = 0x80070002 - ERROR_FILE_NOT_FOUND]
2023-10-11 11:09:06, Info CBS Not able to add %windir%\winsxs\pending.xml.bad to WER report. [HRESULT = 0x80070002 - ERROR_FILE_NOT_FOUND]
2023-10-11 11:09:07, Info CBS Reboot mark cleared
2023-10-11 11:09:07, Info CBS Winlogon: Simplifying Winlogon CreateSession notifications
2023-10-11 11:09:07, Info CBS Winlogon: Deregistering for CreateSession notifications
2023-10-11 11:09:07, Info CBS FinalCommitPackagesState: Started persisting state of packages
2023-10-11 11:09:07, Info CBS Reporting package change for package: Package_for_RollupFix~31bf3856ad364e35~amd64~~20348.2031.1.11, current: Absent, pending: Default, start: Absent, applicable: Installed, target: Installed, limit: Installed, status: 0x0, failure source: Resolve, reboot required: False, client id: WindowsUpdateAgent, initiated offline: False, execution sequence: 193, first merged sequence: 193, reboot reason: REBOOT_NOT_REQUIRED, RM App session: -1, RM App name: N/A, FileName in use: N/A, release type: Security Update, OC operation: False, download source: 0, download time (secs): 4294967295, download status: 0x0 (S_OK), Express download: False, Download Size: 0 Used lower priority: False Priority changes: 0
2023-10-11 11:09:07, Info CBS Reporting package change completion for package: Package_for_RollupFix~31bf3856ad364e35~amd64~~20348.2031.1.11, current: Absent, original: Absent, target: Installed, status: 0x80073701, failure source: Resolve, failure details: "(null)", client id: WindowsUpdateAgent, initiated offline: False, execution sequence: 193, first merged sequence: 193, pending decision: InteractiveInstallFailed, primitive execution context: Interactive
2023-10-11 11:09:07, Info CBS The store corruption status report is incomplete. [HRESULT = 0x80070002 - ERROR_FILE_NOT_FOUND]
2023-10-11 11:09:07, Info CBS Resolve time performance datapoint is invalid. [HRESULT = 0x80070490 - ERROR_NOT_FOUND]
2023-10-11 11:09:07, Info CBS Stage time performance datapoint is invalid. [HRESULT = 0x80070490 - ERROR_NOT_FOUND]
2023-10-11 11:09:07, Info CBS Execute time performance datapoint is invalid. [HRESULT = 0x80070490 - ERROR_NOT_FOUND]
2023-10-11 11:09:08, Info CBS FinalCommitPackagesState: Completed persisting state of packages
2023-10-11 11:09:08, Info CBS Enabling LKG boot option
2023-10-11 11:09:08, Info CBS Removing the pending hard reserve adjustment for Client: WindowsUpdateAgent, Session: 31063123_1980222691
2023-10-11 11:09:08, Info CBS Failed NTFS compressing file \\?\C:\Windows\Servicing\Sessions\31063123_1980222691.xml [HRESULT = 0x80070301 - ERROR_COMPRESSION_DISABLED]
2023-10-11 11:09:08, Info CBS Failed compressing file \\?\C:\Windows\Servicing\Sessions\31063123_1980222691.xml [HRESULT = 0x80070301 - ERROR_COMPRESSION_DISABLED]
2023-10-11 11:09:08, Info CBS Failed to WOF compress \\?\C:\Windows\Servicing\Sessions\31063123_1980222691.xml [HRESULT = 0x80070301 - ERROR_COMPRESSION_DISABLED]
2023-10-11 11:09:08, Info CBS Exec: Will not run corruption repair because no store corruption found.
2023-10-11 11:09:08, Info CBS Exec: Processing complete. Session: 31063123_1980222691, Package: Package_for_ServicingStack_2032~31bf3856ad364e35~amd64~~20348.2032.1.1, Identifier: KB5031590 [HRESULT = 0x80073701 - ERROR_SXS_ASSEMBLY_MISSING]
2023-10-11 11:11:11, Info CBS Deleting directory: \\?\C:\Windows\CbsTemp\31063123_1980222691\
2023-10-11 11:11:11, Info CBS Moving directory from \\?\C:\Windows\CbsTemp\31063123_1980222691\ to \\?\C:\Windows\CbsTemp\{CE039A8F-8060-41C6-AD86-52A11064F7C6}
2023-10-11 11:11:15, Info CBS Deletion of: \\?\C:\Windows\CbsTemp\{CE039A8F-8060-41C6-AD86-52A11064F7C6} successful
2023-10-11 11:13:16, Info CBS Trusted Installer is shutting down because: SHUTDOWN_REASON_AUTOSTOP
2023-10-11 11:13:16, Info CBS TiWorker signaled for shutdown, going to exit.

[#3]

You can also try a repair install by running setup.exe from the root of install media but this seems risky for a domain controller. Also these sorts of issues are not worth spending any time on. Much simpler and safer to stand up a new one for replacement.        

I'd use dcdiag / repadmin tools to verify health `correcting all errors found` before starting `any` operations. Then stand up the new 2022, patch it fully, license it, join existing domain, add active directory domain services, promote it also making it a GC (recommended), transfer FSMO roles over (optional), transfer pdc emulator role (optional), use dcdiag / repadmin tools to again verify health, when all is good you can decommission / demote old one.      

[#4]

@flucas-SG330 just checking if there's any progress or updates? please don't forget to mark helpful replies.     

[#5]

@flugas-sg330
Got the same issue here. We have 14 customers with Hyper-V 2022 hosts. None of them have any problems except one. We can update the host without any problems but the 2 VM's are not willing to install kb5030216 or kb5031364 (September and October updates).
Same error.
I hope Dave's solution is not the only solution for this.

[#6]

I've got this problem on a standalone Windows Server 2022 version 10.0.20348.1607

Gives error 0x800f0982 on every attempt.

SYSNATIVE's ComponentsScanner logs these errors:

== Missing Files ==
C:\Windows\winsxs\Catalogs\a296c8404dcefc089c42fcd18422c0dcb6f602c71abd9f2ec27be92fff3433a1.cat (CanonicalData\Deployments\microsoft-w..-deployment_31bf3856ad364e35_10.0.20348.1547_68ce0f932e0be5a5 contains CatalogThumbprint value a296c8404dcefc089c42fcd18422c0dcb6f602c71abd9f2ec27be92fff3433a1 but no corresponding file found in WinSxS)
C:\Windows\winsxs\Catalogs\e082dc731f78f74acda13791c6e091595d0b9bef43df0117415c77f9e73890df.cat (CanonicalData\Deployments\microsoft-w..anguagepack_31bf3856ad364e35_10.0.20348.946_4963a3eab6afee1f contains CatalogThumbprint value e082dc731f78f74acda13791c6e091595d0b9bef43df0117415c77f9e73890df but no corresponding file found in WinSxS)

== Missing Registry Keys ==
CanonicalData\Catalogs\a296c8404dcefc089c42fcd18422c0dcb6f602c71abd9f2ec27be92fff3433a1 (CanonicalData\Deployments\microsoft-w..-deployment_31bf3856ad364e35_10.0.20348.1547_68ce0f932e0be5a5 has CatalogThumbprint value a296c8404dcefc089c42fcd18422c0dcb6f602c71abd9f2ec27be92fff3433a1 but no corresponding Catalog key exists)
CanonicalData\Catalogs\e082dc731f78f74acda13791c6e091595d0b9bef43df0117415c77f9e73890df (CanonicalData\Deployments\microsoft-w..anguagepack_31bf3856ad364e35_10.0.20348.946_4963a3eab6afee1f has CatalogThumbprint value e082dc731f78f74acda13791c6e091595d0b9bef43df0117415c77f9e73890df but no corresponding Catalog key exists)

No amount of cleaning/fixing/etc. for DISM or SFC or SxS cleanup helps. Cleaned out C:\Windows\SoftwareDistribution folder too.