Using Copy-SPSite with 200gb database and migration options in SharePoint 2013

%3CLINGO-SUB%20id%3D%22lingo-sub-159935%22%20slang%3D%22en-US%22%3EUsing%20Copy-SPSite%20with%20200gb%20database%20and%20migration%20options%20in%20SharePoint%202013%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-159935%22%20slang%3D%22en-US%22%3E%3CP%3EHello%2C%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EI%20want%20to%20split%20a%20200%20GB%20web%20application%20that%20only%20has%20the%20root%20site%20collection%20into%20several%20databases.%20I%20made%20a%20test%20in%20my%20dev%20environment%20with%20success%20using%20Copy-SPSite%20PowerShell%20cmdlet%20(%3CA%20href%3D%22https%3A%2F%2Fwww.toddklindt.com%2Fblog%2FLists%2FPosts%2FPost.aspx%3FID%3D372%22%20target%3D%22_blank%22%20rel%3D%22nofollow%20noopener%20noreferrer%20noopener%20noreferrer%20noopener%20noreferrer%22%3Ehttps%3A%2F%2Fwww.toddklindt.com%2Fblog%2FLists%2FPosts%2FPost.aspx%3FID%3D372%3C%2FA%3E).%20My%20content%20database%20in%20my%20development%20environment%20has%201.2%20GB%20in%20size%20and%20the%20cmdlet%20was%20executed%20sucessfully.%3C%2FP%3E%0A%3CP%3EMy%20concern%20is%20using%20the%20Copy-SPSite%20with%20a%20200gb%20or%20more.%20Is%20there%20any%20limit%20on%20the%20database%20limit%20for%20the%20Copy-SPSite%20cmdlet%3F%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EI%20know%20we%20can%20use%20Sharegate%20or%20other%20third%20party%20tool%20to%20do%20the%20job%20but%20I%20believe%20it%20would%20take%20longer%20than%20the%20this%20approach.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EMy%20scenario%20is%20that%20I%20want%20to%20split%20the%20content%20database%20in%20several%20content%20databases%20(one%20content%20db%20for%20each%20of%20new%20site%20collections%20I%20will%20create).%20I%20considered%20Copy-SPSite%20because%20it%20would%20allow%20the%20following%20approach%3A%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3ECreate%20a%20duplicate%20of%20my%20site%20collection%20faster%20that%20migration%20using%20a%203rd%20party%20tool%3C%2FLI%3E%0A%3CLI%3EIn%20the%20destination%20site%20collection%2C%20I%20would%20delete%20everything%20I%20don't%20need%20(everything%20except%20what%20I%20want%20to%20migrate)%3C%2FLI%3E%0A%3CLI%3EIn%20the%20origin%20site%20collection%2C%20I%20would%20delete%20the%20data%20that%20I%20don't%20any%20more%20(basically%20the%20information%20I%20want%20to%20migrate)%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3EAlthough%20this%20looks%20overkill%2C%20it%20would%20allow%3A%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3EFast%20creation%20of%20the%20new%20site%20collection%20and%20users%20could%20start%20working%20in%20the%20new%20site%20collection%20much%20faster%20than%20using%20a%20migration%20tool%20like%20Sharegate%20or%20similar%203rd%20party%20migration%20tool%20that%20from%20previous%20experience%20it%20can%20take%20a%20lot%20of%20time%20to%20accomplish%20a%20migration%20(depends%20on%20CPU%2C%20memory%20of%20the%20PC%20where%20it%20is%20installed%2C%20network%20conditions%2C%20etc).%20I%20have%20several%20document%20libraries%20I%20want%20to%20migrate%20and%20some%20of%20them%20have%2050GB%20and%20would%20like%20to%20make%20sure%20that%20users%20could%20quickly%20start%20working%20in%20the%20new%20site%20collection%20without%20having%20to%20wait%20many%20hours%20or%20days%20until%20the%20migration%20using%20a%203rd%20party%20tool%20is%20complete%20(it%20should%20be%20much%20slower)%3C%2FLI%3E%0A%3CLI%3EUsing%20Copy-Site%2C%20workflow%20history%20is%20maintained.%20If%20I%20use%20a%20migration%20tool%2C%20I%20cant%20migrate%20workflow%20history%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3EFrom%20what%20I%20read%20in%20some%20articles%20in%20the%20web%20(Ex%3A%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Fblogs.technet.microsoft.com%2Fchristianheim%2F2017%2F03%2F09%2Fcarefully-consider-using-the-copy-spsite-command%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%20noopener%20noreferrer%20noopener%20noreferrer%22%3Ehttps%3A%2F%2Fblogs.technet.microsoft.com%2Fchristianheim%2F2017%2F03%2F09%2Fcarefully-consider-using-the-copy-spsite-command%3C%2FA%3E)%2C%20there%20are%20a%20few%20problems%20that%20can%20arise%20from%20using%20Copy-SPSite%2C%20essentially%20duplicate%20GUIDs%20even%20with%20different%20site%20colllections.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EMy%20questions%20are%3A%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3EUsing%20a%20migration%203rd%20party%20tool%20onprem%2C%20how%20fast%20is%20migrating%20large%20amounts%20of%20data%20(I%20know%20it%20depends%20on%20the%20above%20conditions%20I%20mention%20above)%3F%3C%2FLI%3E%0A%3CLI%3EAssuming%20is%20slow%20(can%20take%20days%20to%20migrate%2050gb)%2C%20what%20alternatives%20do%20I%20have%3F%20A%20couple%20I%20remember%3A%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%201.%20Using%20Copy-SPSite%20-%20the%20approach%20I%20tried%2C%20doubts%20about%20supported%20db%20size%20and%20problems%20with%20duplicate%20GUIDs%20event%20in%20different%20content%20databases%20(not%20sure%20if%20it%20is%20a%20problem%20if%20we%20use%20different%20content%20databases%20that%20is%20my%20case)%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%202.%20Using%20Backup-Site%20and%20Restore-SPSite%20-%20same%20concerns%20here%20about%20Copy-SPSite%20approach%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%203.%20Using%20DB%20Backup%20and%20Restore%20-%20I%20believe%20this%20could%20work%2C%20but%20SharePoint%20content%20DB%20ID%20itself%20must%20be%20changed%20to%20be%20unique%20and%20the%20problem%20with%20GUIDs%20can%20also%20happen%20here%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%204.%20Using%20Export-SPWeb%20-%20this%20allows%20a%20more%20granular%20copy%20or%20move%20but%20has%20as%20advantage%20the%20fact%20of%20not%20allowing%20WF%20history%20to%20be%20preserved%20(new%20GUIDs%20are%20creating%20during%20import%20and%20probably%20workflow%20history%20is%20lost)%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EIn%20general%2C%20in%20this%20scenario%2C%20what%20would%20be%20the%20best%20approach%20to%3A%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%201%20-%20Quicky%20large%20amounts%20of%20data%20(50%20GB%20in%20a%20single%20document%20library)%20to%20a%20new%20site%20collection%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%202%20-%20Preserve%20workflow%20history%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%203%20-%20Avoid%20duplicate%20GUIDs%20in%20content%20databases.%20Not%20sure%20this%20is%20a%20problem%20with%20different%20content%20databases%20(if%20is%20for%20sure%20in%20the%20same%20content%20db).%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EWhat%20is%20your%20recommendation%3F%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-159935%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3ESharePoint%20Server%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E%3CLINGO-SUB%20id%3D%22lingo-sub-848643%22%20slang%3D%22en-US%22%3ERe%3A%20Using%20Copy-SPSite%20with%20200gb%20database%20and%20migration%20options%20in%20SharePoint%202013%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-848643%22%20slang%3D%22en-US%22%3E%3CP%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F40896%22%20target%3D%22_blank%22%3E%40Miguel%20Lopes%20Isidoro%3C%2FA%3E%26nbsp%3B%3C%2FP%3E%3CP%3EHi!%20We%20are%20facing%20similar%20problems%20here%2C%20and%20we%20are%20thinking%20about%20splitting%26nbsp%3B%20a%20content%20database%20into%20two%20by%20using%20copy-SPsite%20to%20copy%20the%20content%20into%20a%20new%20database.%20We%20will%20then%20delete%20webs%20so%20that%20the%20same%20web%20are%20only%20in%20one%20of%20the%20databases.%20One%20of%20the%20databases%20will%20be%20more%20of%20an%20archive.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EHow%20did%20you%20proceed%3F%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3ERegards%3C%2FP%3E%3CP%3EJesper%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E
Highlighted
Contributor

Hello,

 

I want to split a 200 GB web application that only has the root site collection into several databases. I made a test in my dev environment with success using Copy-SPSite PowerShell cmdlet (https://www.toddklindt.com/blog/Lists/Posts/Post.aspx?ID=372). My content database in my development environment has 1.2 GB in size and the cmdlet was executed sucessfully.

My concern is using the Copy-SPSite with a 200gb or more. Is there any limit on the database limit for the Copy-SPSite cmdlet?

 

I know we can use Sharegate or other third party tool to do the job but I believe it would take longer than the this approach.

 

My scenario is that I want to split the content database in several content databases (one content db for each of new site collections I will create). I considered Copy-SPSite because it would allow the following approach:

  • Create a duplicate of my site collection faster that migration using a 3rd party tool
  • In the destination site collection, I would delete everything I don't need (everything except what I want to migrate)
  • In the origin site collection, I would delete the data that I don't any more (basically the information I want to migrate)

Although this looks overkill, it would allow:

  • Fast creation of the new site collection and users could start working in the new site collection much faster than using a migration tool like Sharegate or similar 3rd party migration tool that from previous experience it can take a lot of time to accomplish a migration (depends on CPU, memory of the PC where it is installed, network conditions, etc). I have several document libraries I want to migrate and some of them have 50GB and would like to make sure that users could quickly start working in the new site collection without having to wait many hours or days until the migration using a 3rd party tool is complete (it should be much slower)
  • Using Copy-Site, workflow history is maintained. If I use a migration tool, I cant migrate workflow history

From what I read in some articles in the web (Ex: https://blogs.technet.microsoft.com/christianheim/2017/03/09/carefully-consider-using-the-copy-spsit...), there are a few problems that can arise from using Copy-SPSite, essentially duplicate GUIDs even with different site colllections.

 

My questions are:

  • Using a migration 3rd party tool onprem, how fast is migrating large amounts of data (I know it depends on the above conditions I mention above)?
  • Assuming is slow (can take days to migrate 50gb), what alternatives do I have? A couple I remember:

          1. Using Copy-SPSite - the approach I tried, doubts about supported db size and problems with duplicate GUIDs event in different content databases (not sure if it is a problem if we use different content databases that is my case)

          2. Using Backup-Site and Restore-SPSite - same concerns here about Copy-SPSite approach

          3. Using DB Backup and Restore - I believe this could work, but SharePoint content DB ID itself must be changed to be unique and the problem with GUIDs can also happen here

          4. Using Export-SPWeb - this allows a more granular copy or move but has as advantage the fact of not allowing WF history to be preserved (new GUIDs are creating during import and probably workflow history is lost)

 

In general, in this scenario, what would be the best approach to:

        1 - Quicky large amounts of data (50 GB in a single document library) to a new site collection

        2 - Preserve workflow history

        3 - Avoid duplicate GUIDs in content databases. Not sure this is a problem with different content databases (if is for sure in the same content db).

 

What is your recommendation?

1 Reply
Highlighted

@Miguel Lopes Isidoro 

Hi! We are facing similar problems here, and we are thinking about splitting  a content database into two by using copy-SPsite to copy the content into a new database. We will then delete webs so that the same web are only in one of the databases. One of the databases will be more of an archive.

 

How did you proceed?

 

Regards

Jesper