Enable Application groups AVD with Azure AD Group (through PIM)

I would like to use the PIM feature to use one group enable both applications and login on the avd vm.
However, when the user requests to become a member of that group (which would enable both access and their apps on AVD) and tries to access the app link via AVD, it does not display anything; if I perform a log-out / log-in to the app portal these are now seen; have any of you ever tried this?
At the moment I have solved it by creating a fixed application group and a group that via pim enables access to the vm with the Virtual Machine User Login role; however, I would like to be able to use one group to enable everything.