System Center Operations Manager alerts I can't close?

Hello, 

(mind you I've just started really working with SCOM, prior to this I have known about it's existence and what it can do (globally)).

We have System Center 2022 version 10.22.10118.0 (Retail).
Recently we've been seeing how we can monitor Certificates for Agent Managed Windows Servers.
Through the out of the box Management Pack.

Since we enabled this, we received some alerts about for example expired certificates.
After we received these alerts we started looking into them and now seem to have run into an issue.

We now have a few alerts (which are monitor alerts) which we can't remove from the "Monitoring > Active Alerts" console view.
Manually closing them doesn't seem to do anything (i read about how I COULD be able to manually close them when they are generated through "Certificate Expiry Monitor".. (setting the Administration > Settings > Alerts > Alert Closure Experience (for example)).

So we have for example one alert which is the "Certificate Expiry Monitor" which is alerting for an Unhealthy Certificate.
The alert context mentions: Critical - The certificate is expired. It expired on *** blabla.

Another way I read was if you want to remove such alerts you could:
Disable the alert (or create an override) and then you should be able to close them (or they would get removed automatically if its set like auto-closure when underlying monitor health is resolved or reset manually).

Well none of this works.
I've also tried resolving them through powershell, but that also doesn't remove the alerts (i.e.. change it's ResolutionState to 255).
where i tied through get-scomalert -> set-scomalert when the override was in place for example SCOMClass -DisplayName "Microsoft Certificates Certificate"
Also tried to completely disable the Authoring > Monitors > Microsoft Certificates Certificate > Entity Health > For all objects of class....
and then trying to set the resolutionstate, also doesnt do anthing (not getting any error warnings when I do so in powershell).
Reverting that and overriding that Authoring > Monitors > Microsoft Certificates Certificate > Entity Health > For all objects of class....
and then trying to set the resolutionstate, also doesnt do anthing (not getting any error warnings when I do so in powershell).

Also removing for example the certificate from the server (it's in the \Personal store of this particular windows server) doesn't do anything.
(i've since re-imported it again)
So now I'm a bit lost.

If I go to Monitoring > Microsoft Certificate Monitoring > All certificates
I don't see the certificate mentioned for this host there.

Then we have another 3 certificate monitors in alert which we can't seem to remove, but those are "Certificate Chain Monitor" alerts.
For those we have the same issue, can't somehow close those.

Does anyone have any ideas what we can try next to get them removed from the Alert view?
So the end goal is to somehow set these alerts to ResolutionState 255, OR in the case for example for the certificate expiry alert, just remove the object/entity that it's alerting for from SCOM since I can just delete the certificate from the server, but ya, the object/entity in SCOM seems to stay (or at least the alert does).

I've also tried to see if it was some sort of console caching problem by clearing the console cache, but that doesn't seem to be the issue either.

Help is appreciated!

Kind regards,
JDGP