Forum Discussion
Copy already uploaded files from SPO or OneDrive to Azure blob
Hi everyone,
since mover.io is now retired, we are looking for an alternative to copy large (!) files (>10GB) and a huge amount of data in total (500GB-1TB) that are already in our sharepoint directory to an existing azure blob storage, including the structure (folders). We don't want to use third party tools like ShareGate or others.
I have been researching for days now, but cannot find any solution, but as all services are built by Microsoft I guess there has to be a way somehow.
For the newly launched 'migration manager' as replacement for mover, https://learn.microsoft.com/de-de/sharepointmigration/migrate-to-sharepoint-online that it does not support Azure Blob Storage.
Since Power Automate does not support large files (afaik), that is also no workaround.
It is of course possible to migrate data from on-premis devices, but as the data is already uploaded into sharepoint, we would have to download it, to upload it back into the cloud... which of course does not make a lot of sense.
As it is easy to copy data from sharepoint to OneDrive, we can also copy the data from there into Azure.
Does anyone have the same problem? I'd be glad if you could share your experiences with us.
5 Replies
- nassocaCopper ContributorTry Azure Data Factory , it is a cloud-based data integration service that can be used to orchestrate and automate data movement and transformation. You can create a pipeline in Azure Data Factory to copy the files from your SharePoint directory to Azure Blob Storage. It supports copying large files and can preserve the folder structure during the migration process.
Or try third-party tools that meets your needs to copy in direct way from SPO\Onedrive to Azure blob . Consider researching reputable and secure options and I can list you some , check Sharegate , Gs Richcopy360 and Cloudfuze .- brand007Copper Contributor
nassoca Thank you!! I was into the process of creating an azure app to copy data from SPO until I received the message of https://learn.microsoft.com/de-de/sharepoint/dev/sp-add-ins/retirement-announcement-for-azure-acs (popped up in the SPO App connection-section, where you enter the app credentials)
Is there a new/different workaround, that I'm missing to create this pipeline? Their must be another way, since third party tools must (somehow) use the same environment. I'm browsing the documents provided by Microsoft (like Modernization guidance) but it's a jungle -.-
As mentioned, we are trying to avoid third party tools. Unfortunately they won't make sense to us, as their pricing is too high for our purpose. (Instead of spending thousands of $ a year to shift data to azure blob we could simply leave the data in a hot storage, and still be below these costs).
How about leveraging SharePoint Migration Tool to migrate the data from SharePoint Online to Blob storage?
- brand007Copper Contributor
Kidd_Ip Thanks for the suggestion!
I'm not sure if that will work with "Sharepoint Online" as well. As far as I understand it works with "Sharepoint Server" (up to 2019), which (if I read it right) basically only works as on-prem service - which would lead to the same re-uploading process.
I will give it a try the next days (to hopefully prove myself wrong) and leave my experiences here.
- brand007Copper ContributorUpdate: Unfortunately does not work with SPO urls (for a scan it needs to use a SP Server 2016 / 2019 /... URL)