MS List Teams App not working for a Teams List, but works for a Communication Site List

So whenever I try to copy/paste the link from a SharePoint Teams's Site List into the actual Teams thru the MS List app, I get the following error:

However if I tried copy pasting a link from a a random communication site, it works!

Are there specific types of Lists allowed to be used with MS List app in Teams? Like it only works with Lists in Communication Sites or something like that?