Public Folder Migration to SharePoint Online

%3CLINGO-SUB%20id%3D%22lingo-sub-207019%22%20slang%3D%22en-US%22%3EPublic%20Folder%20Migration%20to%20SharePoint%20Online%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-207019%22%20slang%3D%22en-US%22%3E%3CP%3EHello%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EI%20am%20using%20SharePoint%20High%20Speed%20Migration%20API%20to%20migrate%20public%20folder%20migration%20to%20SharePoint%20online%20with%20the%20help%20of%20following%20article%26nbsp%3B%3CA%20title%3D%22OFFICE%20365%20SHAREPOINT%20PARALLEL%20HIGH%20SPEED%20MIGRATION%20POWERSHELL%20EXAMPLE%20SCRIPTS%22%20href%3D%22http%3A%2F%2Fwww.sharepointevolved.com%2F2015%2F09%2F22%2Foffice-365-sharepoint-parallel-high-speed-migration-powershell-example-scripts%2F%22%20target%3D%22_blank%22%20rel%3D%22nofollow%20noopener%20noreferrer%22%3Ehttp%3A%2F%2Fwww.sharepointevolved.com%2F2015%2F09%2F22%2Foffice-365-sharepoint-parallel-high-speed-migration-powershell-example-scripts%2F%3C%2FA%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EI%20did%20some%20POC%20from%20VM%20and%20able%20to%20migrate%2010-12%20GB%2Fhour.%20However%20I%20noticed%20couple%20of%20things%26nbsp%3B%3C%2FP%3E%3CP%3E1.%26nbsp%3B%20It%20is%20keeping%20the%20createdDate%2C%20Modified%20Date%20as%20it%20is%20but%20CreatedBy%20and%20Modified%20by%20metadata%20always%20coming%20as%20Builtin%5CAdministrator%20instead%20of%20actual%20username.%3C%2FP%3E%3CP%3E2.%20Thru%20script%20I%20uploaded%2022%20GB%20data%20which%20contains%26nbsp%3B1506%20files%20and%201518%20folders.%20When%20I%20see%20in%20Site%20Contents%20are%20showing%203012%20items%20and%20re-checked%20each%20folder%20no%20files%20are%20missing.%20But%20when%20I%20see%20Storage%20Matrix%20it%20is%20showing%2059.6%20GB%20instead%20of%2022%20GB.%20I%20rechecked%20couple%20of%20total%20no%20of%20items%20are%20still%203012.%20Any%20idea%20why%20the%20storage%20matrix%20showing%20almost%20double%20size.%3C%2FP%3E%3CP%3E3.%20I%20also%20noticed%20you%20can%20not%20upload%20any%20files%20which%20is%20more%20than%202%20GB%2C%20probably%20API%20limitation.%20How%20the%20third%20party%20vendor%20managing%20this%20limitation%20as%20they%20mentioned%20in%20their%20site%20that%20they%20are%20also%20using%20the%20same%20API%3F%20In%20real%20scenario%20we%20have%20so%20many%20files%20which%20are%20between%2012-14%26nbsp%3B%20GB's%20file%2C%20how%20do%20we%20handle%20this%3F%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EHowever%20I%20also%20tried%20Migration%20Tool%20v%202%2C%20but%20performance%20is%20almost%20same%20and%20same%202%20GB%20file%20limitations.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EThen%20I%20create%20simple%20script%20using%20CSOM%2C%20I%20can%20upload%20files%20up%2015GB%20file%20but%20problem%20is%20performance%20I%20got%20only%201%20GB%2Fhour%20migration%20speed.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EPlease%20share%20your%20opinion%20on%20performance%20and%20file%20upload%20size.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EAvian%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-207019%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EFiles%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EPowerShell%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3ESharePoint%20Online%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E%3CLINGO-SUB%20id%3D%22lingo-sub-207794%22%20slang%3D%22en-US%22%3ERe%3A%20Public%20Folder%20Migration%20to%20SharePoint%20Online%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-207794%22%20slang%3D%22en-US%22%3EWell%2C%20not%20sure%20if%20the%20migration%20tool%20preserves%20permissions%20you%20have%20OnPrem%20(For%20sure%20it%20does%20when%20migration%20from%20a%20SharePoint%202013%20to%20SPO)...I%20have%20not%20tested%20that%20scenario%2C%20but%20the%20tool%20(and%20also%20third%20party%20ones)%20should%20include%20a%20kind%20of%20mapping%20so%20security%20is%20preserved%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-207786%22%20slang%3D%22en-US%22%3ERe%3A%20Public%20Folder%20Migration%20to%20SharePoint%20Online%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-207786%22%20slang%3D%22en-US%22%3E%3CP%3EThanks%20for%20clarification%20Juan.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EIs%20there%20any%20way%20to%20migrate%20files%20permission%20using%20High%20Speed%20migration%20API%3F%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EIs%20MS%20Migration%20tool%20migrate%20permission%20as%20well%3F%20I%20tested%20but%20it%20doesnt%20migrate%20permission%2C%20may%20be%20I%20missed%20any%20settings%2C%20Can%20you%20please%20confirm%3F%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EAvian%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-207304%22%20slang%3D%22en-US%22%3ERe%3A%20Public%20Folder%20Migration%20to%20SharePoint%20Online%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-207304%22%20slang%3D%22en-US%22%3EMy%202%20cents%20here%3A%3CBR%20%2F%3E1.%20The%20FAST%20Migration%20API%20seems%20to%20not%20preserve%20your%20metadata%20properly%20so%20I%20advise%20to%20move%20to%20the%20SPO%20Migration%20Tool%20or%20a%20third%20party%20one.%3CBR%20%2F%3E2.%20I%20have%20seen%20this%20also%20when%20doing%20some%20migrations%20and%20I%20have%20not%20an%20explanation%20about%20why%20the%20storage%20metrics%20page%20is%20showing%20more%20space%20occupied%20by%20the%20data%20that%20what%20you%20have%20OnPrem.%3CBR%20%2F%3E3.%20I%20believe%20is%20just%20a%20limitation%20of%20the%20Fast%20Migration%20API.%20As%20you%20have%20verified%2C%20for%20files%20greater%20than%202%20GB%20you%20will%20have%20to%20use%20CSOM%20but%20then%20you%20will%20have%20the%20bad%20CSOM%20performance.%3C%2FLINGO-BODY%3E
Frequent Contributor

Hello

 

I am using SharePoint High Speed Migration API to migrate public folder migration to SharePoint online with the help of following article http://www.sharepointevolved.com/2015/09/22/office-365-sharepoint-parallel-high-speed-migration-powe...

 

I did some POC from VM and able to migrate 10-12 GB/hour. However I noticed couple of things 

1.  It is keeping the createdDate, Modified Date as it is but CreatedBy and Modified by metadata always coming as Builtin\Administrator instead of actual username.

2. Thru script I uploaded 22 GB data which contains 1506 files and 1518 folders. When I see in Site Contents are showing 3012 items and re-checked each folder no files are missing. But when I see Storage Matrix it is showing 59.6 GB instead of 22 GB. I rechecked couple of total no of items are still 3012. Any idea why the storage matrix showing almost double size.

3. I also noticed you can not upload any files which is more than 2 GB, probably API limitation. How the third party vendor managing this limitation as they mentioned in their site that they are also using the same API? In real scenario we have so many files which are between 12-14  GB's file, how do we handle this?

 

However I also tried Migration Tool v 2, but performance is almost same and same 2 GB file limitations.

 

Then I create simple script using CSOM, I can upload files up 15GB file but problem is performance I got only 1 GB/hour migration speed.

 

Please share your opinion on performance and file upload size.

 

Avian

3 Replies
My 2 cents here:
1. The FAST Migration API seems to not preserve your metadata properly so I advise to move to the SPO Migration Tool or a third party one.
2. I have seen this also when doing some migrations and I have not an explanation about why the storage metrics page is showing more space occupied by the data that what you have OnPrem.
3. I believe is just a limitation of the Fast Migration API. As you have verified, for files greater than 2 GB you will have to use CSOM but then you will have the bad CSOM performance.

Thanks for clarification Juan.

 

Is there any way to migrate files permission using High Speed migration API?

 

Is MS Migration tool migrate permission as well? I tested but it doesnt migrate permission, may be I missed any settings, Can you please confirm?

 

Avian

Well, not sure if the migration tool preserves permissions you have OnPrem (For sure it does when migration from a SharePoint 2013 to SPO)...I have not tested that scenario, but the tool (and also third party ones) should include a kind of mapping so security is preserved