Fullscreen Youtube player stops responding to keys after switching apps

When I alt-tab out of a fullscreen youtube video to another app and then return to edge, every shortcut key stops working until I press tab. Can't use player specific shortcuts like J, K and L, nor can I use Esc to quit fullscreen. This happens in regular edge, canary, and in every computer I own, but not on other chromium browsers like opera or vivaldi.