Limiting In-Channel Meeting Notification to Users who favourite the Channel

We are trying out Teams for our unit. Idea is to have 1 Team and channel per department. We don't have issue in people accessing files / conversation of other channels. But, meeting notifications for 1 channel being sent to entire team is annoying. How to make Teams send invite/notifications only to the users who have marked their channels as favourite?

Thanks in advance,

// Kaja