Startlayout through intune

I made a XML for a startlayout.

With Intune I can sent this startlayout to a group.

When a user logged in and is a member of this group he gets this startlayout and can't unpin the tiles.

This works fine.

When another users logs in and is not a member of that group for thet start layout he still gets the startlayout and can't unpin the tiles. A couple of minutes later he can unpin the tiles, but he still have the same startlayout.

Is a distributed startlayout for al the users on a device? Or can you implement a startlayout only for the users of the group where the policy is for.

MAurits