Change Planner Attachments location

I agree, I am trying to push the usage of Planner for my projects, and use the Site to organize the whole project but the fact that Planner just uploads the attachments to the main folder not only makes the site to looks disorganize, it is also creates confusion among the team members. I read the workaround about uploading the file and then adding the link, that is what I am trying to do but not all the team member do it since it is easier to just add the attachment when the are creating or editing the task. These small details are the reason some please prefer other platforms instead of the MS products.