Attendance report in Teams

Hi, if we are thinking about same thing then you need to change setting in the meeting policy:
Teams Admin Center > Meetings > Meeting Policies and you will see this setting at the bottom of Meeting scheduling section:

Hope that helps. 🙂