Turn On or Off Notification Sounds in Windows 11

You can turn it off individually for apps you've installed using Settings > System > Notifications.