AATP sensor not starting

%3CLINGO-SUB%20id%3D%22lingo-sub-1970303%22%20slang%3D%22en-US%22%3EAATP%20sensor%20not%20starting%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1970303%22%20slang%3D%22en-US%22%3E%3CP%3EHi%20everybody%2C%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EI%20had%20such%20case%3A%3C%2FP%3E%3CP%3EAATP%20sensor%20on%20a%26nbsp%3BHyper-V%20DC%20(all%20other%20DCs%20work%20properly)%20had%20problem%20with%20starting%20for%20%26gt%3B10%20days%2C%20so%20I%20uninstalled%20AATP%20sensor%20and%20tried%20to%20re-install%20this%20sensor.%3C%2FP%3E%3CP%3ENow%20AATP%20sensor%20installation%20(after%20long%20wait%20~5%20minutes)%20fails%20with%20error%200x80070643%20%3A(%3C%2Fimg%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3Eparts%20from%20logs%20(for%20search%20engines%20to%20index%20%3CIMG%20class%3D%22lia-deferred-image%20lia-image-emoji%22%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Fhtml%2Fimages%2Femoticons%2Fsmile_40x40.gif%22%20alt%3D%22%3Asmile%3A%22%20title%3D%22%3Asmile%3A%22%20%2F%3E%3A(%3C%2Fimg%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EMicrosoft.Tri.Sensor.Updater-Errors.log%3A%3C%2FP%3E%3CP%3E2020-12-08%2021%3A23%3A38.8043%20Error%20PerformanceCounterLib%20System.InvalidOperationException%3A%20Cannot%20load%20Counter%20Name%20data%20because%20an%20invalid%20index%20''%20was%20read%20from%20the%20registry.%3CBR%20%2F%3Eat%20Hashtable%20System.Diagnostics.PerformanceCounterLib.GetStringTable(bool%20isHelp)%3CBR%20%2F%3Eat%20Hashtable%20System.Diagnostics.PerformanceCounterLib.get_NameTable()%3CBR%20%2F%3Eat%20Hashtable%20System.Diagnostics.PerformanceCounterLib.get_CategoryTable()%3CBR%20%2F%3Eat%20CategorySample%20System.Diagnostics.PerformanceCounterLib.GetCategorySample(string%20category)%3CBR%20%2F%3Eat%20CategorySample%20System.Diagnostics.PerformanceCounterLib.GetCategorySample(string%20machine%2C%20string%20category)%3CBR%20%2F%3Eat%20string%5B%5D%20System.Diagnostics.PerformanceCounterCategory.GetCounterInstances(string%20categoryName%2C%20string%20machineName)%3CBR%20%2F%3Eat%20new%20Microsoft.Tri.Infrastructure.MetricManager(IConfigurationManager%20configurationManager)%3CBR%20%2F%3Eat%20object%20lambda_method(Closure%2C%20object%5B%5D)%3CBR%20%2F%3Eat%20object%20Autofac.Core.Activators.Reflection.ConstructorParameterBinding.Instantiate()%3CBR%20%2F%3Eat%20void%20Microsoft.Tri.Infrastructure.ModuleManager.AddModules(Type%5B%5D%20moduleTypes)%3CBR%20%2F%3Eat%20ModuleManager%20Microsoft.Tri.Sensor.Updater.SensorUpdaterService.CreateModuleManager()%3CBR%20%2F%3Eat%20async%20Task%20Microsoft.Tri.Infrastructure.Service.OnStartAsync()%3CBR%20%2F%3Eat%20void%20Microsoft.Tri.Infrastructure.TaskExtension.Await(Task%20task)%3CBR%20%2F%3Eat%20void%20Microsoft.Tri.Infrastructure.Service.OnStart(string%5B%5D%20args)%3CBR%20%2F%3E2020-12-08%2021%3A23%3A45.5321%20Error%20PerformanceCounterLib%20System.InvalidOperationException%3A%20Cannot%20load%20Counter%20Name%20data%20because%20an%20invalid%20index%20''%20was%20read%20from%20the%20registry.%3CBR%20%2F%3Eat%20Hashtable%20System.Diagnostics.PerformanceCounterLib.GetStringTable(bool%20isHelp)%3CBR%20%2F%3Eat%20Hashtable%20System.Diagnostics.PerformanceCounterLib.get_NameTable()%3CBR%20%2F%3Eat%20Hashtable%20System.Diagnostics.PerformanceCounterLib.get_CategoryTable()%3CBR%20%2F%3Eat%20CategorySample%20System.Diagnostics.PerformanceCounterLib.GetCategorySample(string%20category)%3CBR%20%2F%3Eat%20CategorySample%20System.Diagnostics.PerformanceCounterLib.GetCategorySample(string%20machine%2C%20string%20category)%3CBR%20%2F%3Eat%20string%5B%5D%20System.Diagnostics.PerformanceCounterCategory.GetCounterInstances(string%20categoryName%2C%20string%20machineName)%3CBR%20%2F%3Eat%20new%20Microsoft.Tri.Infrastructure.MetricManager(IConfigurationManager%20configurationManager)%3CBR%20%2F%3Eat%20object%20lambda_method(Closure%2C%20object%5B%5D)%3CBR%20%2F%3Eat%20object%20Autofac.Core.Activators.Reflection.ConstructorParameterBinding.Instantiate()%3CBR%20%2F%3Eat%20void%20Microsoft.Tri.Infrastructure.ModuleManager.AddModules(Type%5B%5D%20moduleTypes)%3CBR%20%2F%3Eat%20ModuleManager%20Microsoft.Tri.Sensor.Updater.SensorUpdaterService.CreateModuleManager()%3CBR%20%2F%3Eat%20async%20Task%20Microsoft.Tri.Infrastructure.Service.OnStartAsync()%3CBR%20%2F%3Eat%20void%20Microsoft.Tri.Infrastructure.TaskExtension.Await(Task%20task)%3CBR%20%2F%3Eat%20void%20Microsoft.Tri.Infrastructure.Service.OnStart(string%5B%5D%20args)%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EFrom%26nbsp%3BMicrosoft.Tri.Sensor.Deployment.Deployer_xxxxxxxxxxxx.log%20%3A%3C%2FP%3E%3CP%3E2020-12-08%2021%3A23%3A37.1168%20Debug%20CopyServiceLogsOnRevertAction%20Apply%20started%20%5BsuppressFailure%3DFalse%5D%3CBR%20%2F%3E2020-12-08%2021%3A23%3A37.1168%20Debug%20CopyServiceLogsOnRevertAction%20Apply%20finished%3CBR%20%2F%3E2020-12-08%2021%3A23%3A37.1168%20Debug%20StartServiceAction%20Apply%20started%20%5BsuppressFailure%3DFalse%5D%3CBR%20%2F%3E2020-12-08%2021%3A24%3A37.4544%20Error%20ServiceControllerExtension%20ChangeServiceStatus%20failed%20to%20change%20service%20status%20%5Bname%3DAATPSensorUpdater%20status%3DRunning%20Exception%3DSystem.ServiceProcess.TimeoutException%3A%20Time%20out%20has%20expired%20and%20the%20operation%20has%20not%20been%20completed.%3CBR%20%2F%3Eat%20System.ServiceProcess.ServiceController.WaitForStatus(ServiceControllerStatus%20desiredStatus%2C%20TimeSpan%20timeout)%3CBR%20%2F%3Eat%20Microsoft.Tri.Infrastructure.ServiceControllerExtension.ChangeServiceStatus(String%20name%2C%20ServiceControllerStatus%20status%2C%20TimeSpan%20timeout%2C%20Nullable%601%20awaitedStatus)%5D%3CBR%20%2F%3E2020-12-08%2021%3A25%3A38.5356%20Error%20ServiceControllerExtension%20ChangeServiceStatus%20failed%20to%20change%20service%20status%20%5Bname%3DAATPSensorUpdater%20status%3DRunning%20Exception%3DSystem.ServiceProcess.TimeoutException%3A%20Time%20out%20has%20expired%20and%20the%20operation%20has%20not%20been%20completed.%3CBR%20%2F%3Eat%20System.ServiceProcess.ServiceController.WaitForStatus(ServiceControllerStatus%20desiredStatus%2C%20TimeSpan%20timeout)%3CBR%20%2F%3Eat%20Microsoft.Tri.Infrastructure.ServiceControllerExtension.ChangeServiceStatus(String%20name%2C%20ServiceControllerStatus%20status%2C%20TimeSpan%20timeout%2C%20Nullable%601%20awaitedStatus)%5D%3CBR%20%2F%3E2020-12-08%2021%3A26%3A39.6481%20Error%20ServiceControllerExtension%20ChangeServiceStatus%20failed%20to%20change%20service%20status%20%5Bname%3DAATPSensorUpdater%20status%3DRunning%20Exception%3DSystem.ServiceProcess.TimeoutException%3A%20Time%20out%20has%20expired%20and%20the%20operation%20has%20not%20been%20completed.%3CBR%20%2F%3Eat%20System.ServiceProcess.ServiceController.WaitForStatus(ServiceControllerStatus%20desiredStatus%2C%20TimeSpan%20timeout)%3CBR%20%2F%3Eat%20Microsoft.Tri.Infrastructure.ServiceControllerExtension.ChangeServiceStatus(String%20name%2C%20ServiceControllerStatus%20status%2C%20TimeSpan%20timeout%2C%20Nullable%601%20awaitedStatus)%5D%3CBR%20%2F%3E2020-12-08%2021%3A27%3A40.6816%20Error%20ServiceControllerExtension%20ChangeServiceStatus%20failed%20to%20change%20service%20status%20%5Bname%3DAATPSensorUpdater%20status%3DRunning%20Exception%3DSystem.ServiceProcess.TimeoutException%3A%20Time%20out%20has%20expired%20and%20the%20operation%20has%20not%20been%20completed.%3CBR%20%2F%3Eat%20System.ServiceProcess.ServiceController.WaitForStatus(ServiceControllerStatus%20desiredStatus%2C%20TimeSpan%20timeout)%3CBR%20%2F%3Eat%20Microsoft.Tri.Infrastructure.ServiceControllerExtension.ChangeServiceStatus(String%20name%2C%20ServiceControllerStatus%20status%2C%20TimeSpan%20timeout%2C%20Nullable%601%20awaitedStatus)%5D%3CBR%20%2F%3E2020-12-08%2021%3A28%3A42.0287%20Error%20ServiceControllerExtension%20ChangeServiceStatus%20failed%20to%20change%20service%20status%20%5Bname%3DAATPSensorUpdater%20status%3DRunning%20Exception%3DSystem.ServiceProcess.TimeoutException%3A%20Time%20out%20has%20expired%20and%20the%20operation%20has%20not%20been%20completed.%3CBR%20%2F%3Eat%20System.ServiceProcess.ServiceController.WaitForStatus(ServiceControllerStatus%20desiredStatus%2C%20TimeSpan%20timeout)%3CBR%20%2F%3Eat%20Microsoft.Tri.Infrastructure.ServiceControllerExtension.ChangeServiceStatus(String%20name%2C%20ServiceControllerStatus%20status%2C%20TimeSpan%20timeout%2C%20Nullable%601%20awaitedStatus)%5D%3CBR%20%2F%3E2020-12-08%2021%3A28%3A42.0287%20Debug%20InstallActionGroup%20Revert%20started%3CBR%20%2F%3E2020-12-08%2021%3A28%3A42.0287%20Warn%20InstallActionGroup%20Revert%20reverting%20%5BrollbackAction%3DCopyServiceLogsOnRevertAction%20index%3D0%20count%3D9%5D%3CBR%20%2F%3E2020-12-08%2021%3A28%3A42.0287%20Debug%20CopyServiceLogsOnRevertAction%20Revert%20started%3CBR%20%2F%3E2020-12-08%2021%3A28%3A42.0287%20Debug%20CopyServiceLogsOnRevertAction%20Revert%20finished%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EEli%20Ofek%20gave%20me%20a%20hint%20that%20Network%20Interface%20performance%20counters%20have%20problems%20and%20probably%20a%20rebuild%20is%20needed.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EI%20rebuilt%20the%20counters%20according%20to%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Ftroubleshoot%2Fwindows-server%2Fperformance%2Fmanually-rebuild-performance-counters%23rebuild-all-performance-counters-including-extensible-and-third-party-counters%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3Ehttps%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Ftroubleshoot%2Fwindows-server%2Fperformance%2Fmanually-rebuild-performance-counters%23rebuild-all-performance-counters-including-extensible-and-third-party-counters%3C%2FA%3E%26nbsp%3Band%20the%20problem%20was%20solved%26nbsp%3B%3CIMG%20class%3D%22lia-deferred-image%20lia-image-emoji%22%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Fhtml%2Fimages%2Femoticons%2Flaugh_40x40.gif%22%20alt%3D%22%3Alol%3A%22%20title%3D%22%3Alol%3A%22%20%2F%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EThx%2C%20Eli!%3C%2FP%3E%3C%2FLINGO-BODY%3E
Occasional Contributor

Hi everybody,

 

I had such case:

AATP sensor on a Hyper-V DC (all other DCs work properly) had problem with starting for >10 days, so I uninstalled AATP sensor and tried to re-install this sensor.

Now AATP sensor installation (after long wait ~5 minutes) fails with error 0x80070643 :(

 

parts from logs (for search engines to index :smile::(

 

Microsoft.Tri.Sensor.Updater-Errors.log:

2020-12-08 21:23:38.8043 Error PerformanceCounterLib System.InvalidOperationException: Cannot load Counter Name data because an invalid index '' was read from the registry.
at Hashtable System.Diagnostics.PerformanceCounterLib.GetStringTable(bool isHelp)
at Hashtable System.Diagnostics.PerformanceCounterLib.get_NameTable()
at Hashtable System.Diagnostics.PerformanceCounterLib.get_CategoryTable()
at CategorySample System.Diagnostics.PerformanceCounterLib.GetCategorySample(string category)
at CategorySample System.Diagnostics.PerformanceCounterLib.GetCategorySample(string machine, string category)
at string[] System.Diagnostics.PerformanceCounterCategory.GetCounterInstances(string categoryName, string machineName)
at new Microsoft.Tri.Infrastructure.MetricManager(IConfigurationManager configurationManager)
at object lambda_method(Closure, object[])
at object Autofac.Core.Activators.Reflection.ConstructorParameterBinding.Instantiate()
at void Microsoft.Tri.Infrastructure.ModuleManager.AddModules(Type[] moduleTypes)
at ModuleManager Microsoft.Tri.Sensor.Updater.SensorUpdaterService.CreateModuleManager()
at async Task Microsoft.Tri.Infrastructure.Service.OnStartAsync()
at void Microsoft.Tri.Infrastructure.TaskExtension.Await(Task task)
at void Microsoft.Tri.Infrastructure.Service.OnStart(string[] args)
2020-12-08 21:23:45.5321 Error PerformanceCounterLib System.InvalidOperationException: Cannot load Counter Name data because an invalid index '' was read from the registry.
at Hashtable System.Diagnostics.PerformanceCounterLib.GetStringTable(bool isHelp)
at Hashtable System.Diagnostics.PerformanceCounterLib.get_NameTable()
at Hashtable System.Diagnostics.PerformanceCounterLib.get_CategoryTable()
at CategorySample System.Diagnostics.PerformanceCounterLib.GetCategorySample(string category)
at CategorySample System.Diagnostics.PerformanceCounterLib.GetCategorySample(string machine, string category)
at string[] System.Diagnostics.PerformanceCounterCategory.GetCounterInstances(string categoryName, string machineName)
at new Microsoft.Tri.Infrastructure.MetricManager(IConfigurationManager configurationManager)
at object lambda_method(Closure, object[])
at object Autofac.Core.Activators.Reflection.ConstructorParameterBinding.Instantiate()
at void Microsoft.Tri.Infrastructure.ModuleManager.AddModules(Type[] moduleTypes)
at ModuleManager Microsoft.Tri.Sensor.Updater.SensorUpdaterService.CreateModuleManager()
at async Task Microsoft.Tri.Infrastructure.Service.OnStartAsync()
at void Microsoft.Tri.Infrastructure.TaskExtension.Await(Task task)
at void Microsoft.Tri.Infrastructure.Service.OnStart(string[] args)

 

From Microsoft.Tri.Sensor.Deployment.Deployer_xxxxxxxxxxxx.log :

2020-12-08 21:23:37.1168 Debug CopyServiceLogsOnRevertAction Apply started [suppressFailure=False]
2020-12-08 21:23:37.1168 Debug CopyServiceLogsOnRevertAction Apply finished
2020-12-08 21:23:37.1168 Debug StartServiceAction Apply started [suppressFailure=False]
2020-12-08 21:24:37.4544 Error ServiceControllerExtension ChangeServiceStatus failed to change service status [name=AATPSensorUpdater status=Running Exception=System.ServiceProcess.TimeoutException: Time out has expired and the operation has not been completed.
at System.ServiceProcess.ServiceController.WaitForStatus(ServiceControllerStatus desiredStatus, TimeSpan timeout)
at Microsoft.Tri.Infrastructure.ServiceControllerExtension.ChangeServiceStatus(String name, ServiceControllerStatus status, TimeSpan timeout, Nullable`1 awaitedStatus)]
2020-12-08 21:25:38.5356 Error ServiceControllerExtension ChangeServiceStatus failed to change service status [name=AATPSensorUpdater status=Running Exception=System.ServiceProcess.TimeoutException: Time out has expired and the operation has not been completed.
at System.ServiceProcess.ServiceController.WaitForStatus(ServiceControllerStatus desiredStatus, TimeSpan timeout)
at Microsoft.Tri.Infrastructure.ServiceControllerExtension.ChangeServiceStatus(String name, ServiceControllerStatus status, TimeSpan timeout, Nullable`1 awaitedStatus)]
2020-12-08 21:26:39.6481 Error ServiceControllerExtension ChangeServiceStatus failed to change service status [name=AATPSensorUpdater status=Running Exception=System.ServiceProcess.TimeoutException: Time out has expired and the operation has not been completed.
at System.ServiceProcess.ServiceController.WaitForStatus(ServiceControllerStatus desiredStatus, TimeSpan timeout)
at Microsoft.Tri.Infrastructure.ServiceControllerExtension.ChangeServiceStatus(String name, ServiceControllerStatus status, TimeSpan timeout, Nullable`1 awaitedStatus)]
2020-12-08 21:27:40.6816 Error ServiceControllerExtension ChangeServiceStatus failed to change service status [name=AATPSensorUpdater status=Running Exception=System.ServiceProcess.TimeoutException: Time out has expired and the operation has not been completed.
at System.ServiceProcess.ServiceController.WaitForStatus(ServiceControllerStatus desiredStatus, TimeSpan timeout)
at Microsoft.Tri.Infrastructure.ServiceControllerExtension.ChangeServiceStatus(String name, ServiceControllerStatus status, TimeSpan timeout, Nullable`1 awaitedStatus)]
2020-12-08 21:28:42.0287 Error ServiceControllerExtension ChangeServiceStatus failed to change service status [name=AATPSensorUpdater status=Running Exception=System.ServiceProcess.TimeoutException: Time out has expired and the operation has not been completed.
at System.ServiceProcess.ServiceController.WaitForStatus(ServiceControllerStatus desiredStatus, TimeSpan timeout)
at Microsoft.Tri.Infrastructure.ServiceControllerExtension.ChangeServiceStatus(String name, ServiceControllerStatus status, TimeSpan timeout, Nullable`1 awaitedStatus)]
2020-12-08 21:28:42.0287 Debug InstallActionGroup Revert started
2020-12-08 21:28:42.0287 Warn InstallActionGroup Revert reverting [rollbackAction=CopyServiceLogsOnRevertAction index=0 count=9]
2020-12-08 21:28:42.0287 Debug CopyServiceLogsOnRevertAction Revert started
2020-12-08 21:28:42.0287 Debug CopyServiceLogsOnRevertAction Revert finished

 

Eli Ofek gave me a hint that Network Interface performance counters have problems and probably a rebuild is needed.

 

I rebuilt the counters according to https://docs.microsoft.com/en-us/troubleshoot/windows-server/performance/manually-rebuild-performanc... and the problem was solved :lol:

 

Thx, Eli!

0 Replies