intune MDM, IOS device after a restore skips remote Management screen

I am using Intune MDM to enrol the devices.

Enrolling a new device with Manged apple ID works without any issues and I can install profile getting all the apps installed via VPP Apps on the device

When restoring a device from iCloud or a local computer backup taken on iTunes don’t seems to work as expected after a restore, device skips remote management screen and loads into the phone welcome screen. I am taking the backup of the same device and restoring it back, keeping in mind the device was never MDM managed therefore no management profile has been restored. We are using managed apple id’s so no VPP apps downloaded but due to managed Apple id this blocks the store capability of downloading any apps from app store. The device was added into MDM Intune via apple configurator therefore visible on Intune  

1 - Backup to iCloud to keep all data

2 - wiped the device via Erase all content and settings.

3- Added the phone using Apple configurator

4- In ABM I assign the device to the MDM server.

5- kicked in manual sync from Intune. Once the device visible in Intune and profile assigned. start the setup process and select to restore from iCloud or backup from computer.

I expected it to restart after the restore and show the remote management screen, but it does not.

The only way around this is to restore via iCloud to a different device. This is not ideal

Please let us know if you can recommend a better way of doing this therefore restoring the backup on same device and getting remote management configuration to enrol the device on MDM