TDiggs Same here - I did that as well but still SUBMIT button is the problem if we rearrange.
What I did as a work around is that I deleted the date field and replaced it with a text field and named the text field as date and added a sub title for date format - its just that if you do this, you will also be needing to edit your MS FLOW for email notification data not to get affected. Also challenge is that we do have tons of forms which takes time to those steps and once date field is up and running I will be needing to revert all date field to date picker.