If I had a hidden field which is only set by PowerApps, could I prevent everybody else from Updating

Hi Nigel...yes it would be hidden for everyone, including administrators.  SharePoint does not provide field level security. 

The workaround is to create a form specific for the Administrators so it can be secured and they can navigate to it.