Dynamic Filtering using Gallery View (single select)

Using SharePoint Online in a Modern Page/List/Library.

I've setup a List and have a Library that will be filtered by the items in that List.

The List is set with "Allow individual item checkboxes" to false so you can only select a single item at a time.

When I add the List and Library to a SharePoint Page and setup dynamic filtering it works fine - no probs.

However, as soon as I set the List to use the Gallery View it all falls apart. It automatically sets it up so that multiple select is on (even though it's turned off on the list view) so when you select an item in the List you have to check the box to select it (and it does filter the Library), but then you have to manually unselect it to remove the filter. I want it so that you can only select a single item.

Then when I go into the JSON of the Gallery View and set "hideSelection": true, it removes the checkboxes, but then doesn't allow you to select any items so the dynamic filtering doesn't work.

Does anyone know how to setup a list with Gallery View and have it so when you select an item it removes the previous selection (i.e. it only allows you to select a single item just like a normal view with "Allow individual item checkboxes" set to false)?

Ultimately I guess I'm trying to find out how to setup a list with Gallery View that has single select on the items.

Really hoping this can be done, otherwise we'll be forced to do some custom solution which goes against our SPO strategy.