SOLVED

Cordoned AKS nodes Logs or Metrics?

%3CLINGO-SUB%20id%3D%22lingo-sub-2922316%22%20slang%3D%22en-US%22%3ECordoned%20AKS%20nodes%20Logs%20or%20Metrics%3F%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2922316%22%20slang%3D%22en-US%22%3E%3CP%3EWhen%20AKS%20nodes%20are%20in%20Cordoned%20state%2C%20they%20still%20show%20as%26nbsp%3B%3CSTRONG%3E%3CEM%3EREADY%3C%2FEM%3E%3C%2FSTRONG%3E%20but%20in%20%3CEM%3Ecordoned%20status%3C%2FEM%3E%26nbsp%3Bthey%20will%20not%20accept%20scheduling%20new%20pods.%3C%2FP%3E%0A%3CP%3EWhere%20can%20we%20look%20in%20Azure%20Monitor%2C%20or%20better%20stated%2C%20what%20can%20we%20query%20(log%20or%20metric)%20to%20alert%20and%20display%20in%20a%20heath%20dashboard%20for%20example%2C%20when%20an%20AKS%20node%20moves%20in%20and%20out%20of%20the%20Cordoned%20state%3F%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-2922528%22%20slang%3D%22en-US%22%3ERe%3A%20Cordoned%20AKS%20nodes%20Logs%20or%20Metrics%3F%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2922528%22%20slang%3D%22en-US%22%3EI%20got%20someone%20(thanks%20Andrew%20Willow)%20to%20reply%20to%20me%20on%20email%3A%3CBR%20%2F%3E%22This%20will%20be%20recorded%20in%20the%20audit%20logs%20as%20a%20taint%20and%20setting%20an%20unschedulable%20flag.%20I%20don%E2%80%99t%20have%20the%20kusto%20to%20hand%20to%20alert%20on%20this%20but%20it%20should%20be%20there%20if%20they%20have%20diagnostics%20on%22.%3CBR%20%2F%3E%3C%2FLINGO-BODY%3E
Microsoft

When AKS nodes are in Cordoned state, they still show as READY but in cordoned status they will not accept scheduling new pods.

Where can we look in Azure Monitor, or better stated, what can we query (log or metric) to alert and display in a heath dashboard for example, when an AKS node moves in and out of the Cordoned state?

 

1 Reply
best response confirmed by Steve DiStefano (Microsoft)
Solution
I got someone (thanks Andrew Willow) to reply to me on email:
"This will be recorded in the audit logs as a taint and setting an unschedulable flag. I don’t have the kusto to hand to alert on this but it should be there if they have diagnostics on".