Can't remove earlier paired Microsoft BT mouse after replacing BT card

I replaced my internal Wifi/BT card with a newer one and paired my Microsoft BT mouse with it. When looking at the BT device list, I noticed there are 2 instances of the same BT mouse, one which was paired before with the older BT card that I had. This didn't happen when repairing my BT headphones; it replaced the earlier paired headphone instance in the list.

When trying to delete the older MS BT mouse from the list or from the Control Panel, it says "removing failed"

Is there any way I can delete that device from the BT device list?