Is there a way to use a planner within a Team but have some tasks "private", so those tasks are only viewable by the specific people that were assigned to those tasks?
No, you can’t have certain tasks private in a plan! You can create a private plan and add members to this, but everyone in this plan we see all content!
