Do you mean that you want to set the focus (blue shape) on the Cancel button instead of Retry? If so, there is no option to change it in Data Validation settings! But you can create a custom data validation solution using a VBA code!
In fact, I've tried to write this code, but it's not perfect!
The simple workaround is to press tab after the message box pops up to move the focus to the Cancel button.