Best way to migrate data between SPO site collections ("sites") in the same tenant

%3CLINGO-SUB%20id%3D%22lingo-sub-2932603%22%20slang%3D%22en-US%22%3EBest%20way%20to%20migrate%20data%20between%20SPO%20site%20collections%20(%22sites%22)%20in%20the%20same%20tenant%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2932603%22%20slang%3D%22en-US%22%3E%3CP%3EWe've%20had%20a%20few%20cases%20where%20departments%20have%20run%20into%20issues%20by%20cramming%20all%20of%20their%20files%20into%20one%20library%20with%20a%20hideously%20deep%20folder%20hierarchy%20and%20no%20metadata.%20Bad%20on%20them%2C%20yes%2C%20but%20now%20we%20in%20IT%20are%20tasked%20with%20helping%20them%20clean%20up%20the%20mess%20we%20told%20them%20they'd%20create%20without%20proper%20planning.%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EWhat%20is%20the%20recommended%20solution%20for%20performing%20large-scale%20moves%20of%20files%20in%20SharePoint%20Online%3F%20We%20might%20be%20moving%20them%20from%20one%20library%20to%20another%20in%20the%20same%20site%2C%20or%20to%20a%20different%20site%20in%20the%20same%20tenant.%20We've%20tried%20Powershell%20(the%20Move-PnPFile%20method)%2C%20but%20to%20use%20that%2C%20we%20need%20to%20Get%20those%20files%2C%20which%20is%20constrained%20by%20the%205%2C000%20list%20view%20threshold%20(or%20so%20Powershell%20tells%20us).%20The%20%22Move%20to%22%20option%20in%20the%20Modern%20UI%20works%2C%20but%20is%20ingloriously%20tedious%20since%20we%20often%20need%20to%20move%20things%20in%20chunks%20(X%20folders%20at%20a%20time).%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EI%20believe%20the%20Mover%20(part%20of%20the%20SharePoint%20Migration%20toolset%2C%20I%20think%3F)%20is%20probably%20our%20best%20bet%2C%20but%20convincing%20our%20tenant%20admins%20to%20invest%20the%20time%20to%20configure%20and%20allow%20it%20is%20going%20to%20be%20a%20challenge.%20However%2C%20if%20someone%20can%20back%20up%20my%20assumption%20that%20it%20will%20do%20the%20job%20(without%20costing%20us%20anything%20but%20time)%2C%20we%20might%20be%20able%20to%20get%20it%20done.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EAlso%2C%20I%20know%20there%20are%20third-party%20options.%20We%20used%20Sharegate%20to%20migrate%20sites%20and%20content%20from%20our%20SP%202010%20farm%20before%20shutting%20it%20down.%20It%20worked%20great%2C%20but%20we%20couldn't%20justify%20the%20ongoing%20license%20cost%20when%20we%20were%20%22done%22%20that%20migration.%20I%20saw%20something%20like%20our%20current%20situation%20coming%2C%20but%20I'm%20the%20last%20person%20who%20has%20any%20say%20over%20what%20we%20can%20spend%20money%20on.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-2932603%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EDocument%20Library%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3Efiles%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EPowerShell%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3ESharePoint%20Online%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E%3CLINGO-SUB%20id%3D%22lingo-sub-2997075%22%20slang%3D%22en-US%22%3ERe%3A%20Best%20way%20to%20migrate%20data%20between%20SPO%20site%20collections%20(%22sites%22)%20in%20the%20same%20tenant%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2997075%22%20slang%3D%22en-US%22%3E%3CP%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F86417%22%20target%3D%22_blank%22%3E%40Chad_V_Kealey%3C%2FA%3E%26nbsp%3B%3C%2FP%3E%3CP%3EI'm%20also%20looking%20at%20this%20as%20we%20have%20a%20number%20of%20sites%20on%20our%20tenant%20where%20we%20want%20to%20migrate%20the%20content%20to%20other%20sites%20within%20the%20same%20tenant.%26nbsp%3B%20I%20had%20a%20look%20at%20Mover%20but%20I'm%20not%20sure%20if%20it's%20going%20to%20be%20suitable%20for%20our%20needs.%26nbsp%3B%20When%20I%20tried%20to%20use%20the%20same%20365%20connector%20for%20source%20and%20destination%20I%20got%20the%20following%20error%3A%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22gjayne84_0-1637672549572.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F328869iC0152AF1E46E2603%2Fimage-size%2Fmedium%3Fv%3Dv2%26amp%3Bpx%3D400%22%20role%3D%22button%22%20title%3D%22gjayne84_0-1637672549572.png%22%20alt%3D%22gjayne84_0-1637672549572.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%3CP%3EI%20could%20get%20around%20this%20by%20creating%20two%20separate%20365%20connectors%20but%20then%20when%20I%20got%20to%20the%20Migration%20setup%20screen%20it's%20all%20based%20around%20users.%26nbsp%3B%20The%20list%20of%20users%20includes%20Shared%20Documents%20libraries%20for%20Team%20Sites%20but%20no%20other%20libraries%2Flists%20on%20the%20site%3F%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EIt%20seems%20the%20only%20options%20available%20are%2C%20as%20you%20mentioned%2C%20the%20native%20file%20copy%2Fmove%20functionality%20in%20SharePoint%20or%20a%20third-party%20tool%20like%20ShareGate.%26nbsp%3B%20From%20previous%20experience%20the%20copy%2Fmove%20functionality%20is%20fine%20for%20small%20migrations%20but%20for%20anything%20over%20a%20few%20hundred%20files%2Ffolders%20I%20find%20it%20tedious%20as%20you%20said%20and%20also%20there%20isn't%20full%20confidence%20that%20all%20files%20have%20been%20copied%20as%20no%20summary%20etc%20is%20available%20once%20completed.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EFor%20any%20decent%20sized%20migration%20I've%20used%20ShareGate%20in%20the%20past%20as%20it's%20an%20amazing%20tool%20for%20this%20kind%20of%20stuff%2C%20but%20as%20you've%20mentioned%20we%20run%20into%20issues%20with%20cost%20etc.%3C%2FP%3E%3C%2FLINGO-BODY%3E
Regular Contributor

We've had a few cases where departments have run into issues by cramming all of their files into one library with a hideously deep folder hierarchy and no metadata. Bad on them, yes, but now we in IT are tasked with helping them clean up the mess we told them they'd create without proper planning. 

 

What is the recommended solution for performing large-scale moves of files in SharePoint Online? We might be moving them from one library to another in the same site, or to a different site in the same tenant. We've tried Powershell (the Move-PnPFile method), but to use that, we need to Get those files, which is constrained by the 5,000 list view threshold (or so Powershell tells us). The "Move to" option in the Modern UI works, but is ingloriously tedious since we often need to move things in chunks (X folders at a time). 

 

I believe the Mover (part of the SharePoint Migration toolset, I think?) is probably our best bet, but convincing our tenant admins to invest the time to configure and allow it is going to be a challenge. However, if someone can back up my assumption that it will do the job (without costing us anything but time), we might be able to get it done.

 

Also, I know there are third-party options. We used Sharegate to migrate sites and content from our SP 2010 farm before shutting it down. It worked great, but we couldn't justify the ongoing license cost when we were "done" that migration. I saw something like our current situation coming, but I'm the last person who has any say over what we can spend money on.

1 Reply

@Chad_V_Kealey 

I'm also looking at this as we have a number of sites on our tenant where we want to migrate the content to other sites within the same tenant.  I had a look at Mover but I'm not sure if it's going to be suitable for our needs.  When I tried to use the same 365 connector for source and destination I got the following error:

 

gjayne84_0-1637672549572.png

I could get around this by creating two separate 365 connectors but then when I got to the Migration setup screen it's all based around users.  The list of users includes Shared Documents libraries for Team Sites but no other libraries/lists on the site?

 

It seems the only options available are, as you mentioned, the native file copy/move functionality in SharePoint or a third-party tool like ShareGate.  From previous experience the copy/move functionality is fine for small migrations but for anything over a few hundred files/folders I find it tedious as you said and also there isn't full confidence that all files have been copied as no summary etc is available once completed.

 

For any decent sized migration I've used ShareGate in the past as it's an amazing tool for this kind of stuff, but as you've mentioned we run into issues with cost etc.