Is this a glitch or features? I have the problem since the first Windows 11 Insider Preview (Dev Channel, Build 22000.51). But it seems haven't be fixed yet. Mycurrent OS build is 22000.176 (Beta Channel).
Hover on apps with one windows of the same app:
Hover on apps with multiple windows of the same app:
What it suppose to look like when hover on apps with multiple windows of the same app: