Customise Document Site Permissions

Hello Experts!

I am currently using Sharepoint 2019 on-premise as an integrated document library for our on-premise Dynamics CRM instance.

I want to enable limit our users' ability to delete files from the sharepoint site, and I have created a custom permission level, all is swell.

What I have noticed is that users cannot rename files while this permission is set, which is incredibly frustrating to the users, given document generation happens almost every minute with the behaviour of our business.

I am trying to understand what my options are, because our business requirement is to remove the capability to delete files.

Are there any suggestions?

Thank you in advance,

Jayden.