High Delays while syncing changes of office documents

%3CLINGO-SUB%20id%3D%22lingo-sub-1012890%22%20slang%3D%22en-US%22%3EHigh%20Delays%20while%20syncing%20changes%20of%20office%20documents%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1012890%22%20slang%3D%22en-US%22%3EWe%20migrated%20our%20project%20file%20server%20to%20SharePointOnline%20in%20a%20new%20O365%20Tenant.%20About%202%20TB%20and%20about%20450.000%20Elements.%3CBR%20%2F%3EAt%20the%20beginning%20we%20copied%20them%20to%20one%20library%20and%20all%2030%20users%20where%20using%20ODFB%20for%20syncing%20the%20files%20to%20there%20local%20computers%20with%20the%20option%20files%20on%20demand.%20We%20also%20setup%20the%20same%20user%20rights%20in%20SPO%20as%20we%20had%20on%20the%20old%20file%20server.%3CBR%20%2F%3EAfter%20the%20ODFB%20sycronisation%20of%20all%20users%20were%20finished%20we%20are%20facing%20some%20huge%20performance%20issues.%20Some%20users%20had%20to%20wait%20up%20to%2015minuted%20until%20the%20ODFB%20starts%20to%20sync%20after%20a%20reboot.%20If%20they%20are%20changing%20a%20small%20office%20document%20it%20takes%20up%20to%2015%20minutes%20that%20the%20changes%20are%20available%20for%20the%20other%20users%20...%20and%20so%20on.%3CBR%20%2F%3EWe%20contact%20MS%20and%20they%20tell%20us%20to%20split%20the%20files%20to%20new%20libraries.%20Each%20one%20shouldn't%20contain%20more%20then%20300.000%20elements.%3CBR%20%2F%3EWe%20did%20it%20but%20there%20was%20no%20improvement.%3CBR%20%2F%3EI'm%20wondering%20if%20there%20are%20physical%20limitations%20in%20ODFB%20when%20you%20are%20syncing%20to%20many%20files.%20Maybe%20the%20database%20behind%20is%20too%20slow.%3CBR%20%2F%3EWe%20are%20using%20the%20current%20version%20of%20office%20365%2C%20win%2010%201809%2C%20ODFB%20developer%20ring%20version.%20We%20have%20a%20120Mbit%20sym.%20Data%20line%20at%20the%20main%20location.%20The%20traffic%20on%20the%20router%20is%20normal.%3CBR%20%2F%3EDoes%20anyone%20has%20experiences%20with%20the%20syncronisation%20of%20huge%20sharepoint%20libraries%3F%3CBR%20%2F%3EIs%20there%20any%20way%20to%20improve%3F%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-1012890%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EOffice%20365%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EOneDrive%20for%20Business%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E%3CLINGO-SUB%20id%3D%22lingo-sub-1015440%22%20slang%3D%22en-US%22%3ERe%3A%20High%20Delays%20while%20syncing%20changes%20of%20office%20documents%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1015440%22%20slang%3D%22en-US%22%3E%3CP%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F197213%22%20target%3D%22_blank%22%3E%40Andreas%20Ratzke%3C%2FA%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EHi%2C%20I%20have%20had%20the%20exact%20same%20experience%20managing%20IT%20for%20a%20small%20company%20with%2015%20users.%3C%2FP%3E%3CP%3EWe%20have%20about%20450gb%20of%20data%2C%20350.00%20files%20that%20are%20split%20up%20into%20to%204%20libraries%20but%20with%20the%20biggest%20one%20being%20over%20100.000%20items.%20We%20have%201gb%2Fs%20fiber%20connection%20and%20our%20network%20connection%20is%20barely%20breaking%20a%20sweat.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E-Save%20a%20file.%3C%2FP%3E%3CP%3E-Wait%20a%20few%20minutes.%3C%2FP%3E%3CP%3E-%22Uploading%200kb%20of%200%20kb%22%20(no%20network%20utilization)%3C%2FP%3E%3CP%3E-%20Waiting%205%20minutes%20up%20to%201%20hour%20for%20a%20simple%20document%20or%20pdf%20the%20be%20in%20sync.%26nbsp%3B%3C%2FP%3E%3CP%3ESomtimes%20uploads%20stall%20completely.%20The%20only%20way%20to%20fix%20it%20is%20for%20the%20user%20to%20pause%2Frestart%20onedrive.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EFrom%20what%20I%20can%20read%20in%20the%20documentation%20there%20is%20a%20performance%20penalty%20above%20100k%20files%20for%20Onedrive%2C%20and%20also%20above%20350k%20files%20for%20Sharepoint%20online%20libraries.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EIs%20has%20been%20a%20nightmare%20from%20the%20beginning%2C%20and%20we%20are%20still%20not%20sure%20if%20we%20will%20be%20able%20to%20stay%20with%20O365%20for%20our%20files%20or%20if%20we%20have%20to%20find%20another%20solution.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EThis%20problem%20is%20not%20occuring%20in%20the%20regular%20Onedrive%20for%20consumers%20version.%3C%2FP%3E%3CP%3EThere%20is%20definetly%20something%20with%20sharepoint%20online%20that%20is%20killing%20the%20performance%20there.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EI%20have%20tried%20EVERYTHING%20(does%20not%20matter%20which%20OS%2C%20Onedrive%20version%2C%20network%20connection%2Flocation%2C%20filetypes%2C%20firewalls).%3C%2FP%3E%3CP%3EI%20have%20been%20in%20contact%20with%20MS%20support%2C%20no%20luck.%26nbsp%3B%20No%20one%20has%20even%20admitted%20to%20the%20problem%20even%20existing%20or%20have%20been%20able%20to%20find%20something%20wrong%20in%20our%20setup.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3ERight%20now%20we%20are%20preparing%20to%20clean%20up%20our%20data%2C%20and%20move%20it%20into%20two%20separate%20sharepoint%20sites%20and%20also%20into%20different%20libraries.%20This%20way%20I%20am%20hoping%20to%20make%20the%20100k%20and%20300k%20file%20limits%20respectively.%3C%2FP%3E%3CP%3EAlso%20differential%20sync%20is%20rolling%20out%20not%2C%20this%20might%20alleviate%20the%20problem%20a%20little%20bit%2C%20but%20i%20doubt%20is%2C%20since%20it%20is%20not%20the%20actual%20download%2Fupload%20speed%20that%20is%20the%20bottleneck.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EHope%20you%20find%20a%20solution%20or%20get%20out%20while%20you%20can%20%3A)%3C%2Fimg%3E%20Please%20let%20me%20know.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-1028945%22%20slang%3D%22en-US%22%3ERe%3A%20High%20Delays%20while%20syncing%20changes%20of%20office%20documents%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1028945%22%20slang%3D%22en-US%22%3EThanks%20for%20you%20reply.%20I'm%20glad%20that%20we%20are%20not%20alone%20with%20that%20problem.%20But%20I%20really%20want%20to%20know%20if%20it's%20a%20bug%20or%20a%20limitation.%3CBR%20%2F%3EAt%20the%20moment%20we%20are%20synchronizing%20all%20files%20via%20ODFB%20to%20a%20Windows%20Server%20with%20an%20Admin%20Account%20and%20rebuild%20the%20similar%20user%20right%20structure%20there.%20Really%20not%20a%20best%20practice.%3CBR%20%2F%3EHope%20someone%20from%20MS%20can%20give%20us%20an%20answer%20...%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-1044159%22%20slang%3D%22en-US%22%3ERe%3A%20High%20Delays%20while%20syncing%20changes%20of%20office%20documents%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1044159%22%20slang%3D%22en-US%22%3E%3CP%3E%3CA%20href%3D%22https%3A%2F%2Fonedrive.uservoice.com%2Fforums%2F913522-onedrive-on-windows%2Fsuggestions%2F19586047-improve-the-feature-of-synchronizing-more-than-100%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3Ehttps%3A%2F%2Fonedrive.uservoice.com%2Fforums%2F913522-onedrive-on-windows%2Fsuggestions%2F19586047-improve-the-feature-of-synchronizing-more-than-100%3C%2FA%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EMicrosoft%20seems%20to%20be%20working%20on%20that%20issue%20...%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E
Occasional Contributor
We migrated our project file server to SharePointOnline in a new O365 Tenant. About 2 TB and about 450.000 Elements.
At the beginning we copied them to one library and all 30 users where using ODFB for syncing the files to there local computers with the option files on demand. We also setup the same user rights in SPO as we had on the old file server.
After the ODFB sycronisation of all users were finished we are facing some huge performance issues. Some users had to wait up to 15minuted until the ODFB starts to sync after a reboot. If they are changing a small office document it takes up to 15 minutes that the changes are available for the other users ... and so on.
We contact MS and they tell us to split the files to new libraries. Each one shouldn't contain more then 300.000 elements.
We did it but there was no improvement.
I'm wondering if there are physical limitations in ODFB when you are syncing to many files. Maybe the database behind is too slow.
We are using the current version of office 365, win 10 1809, ODFB developer ring version. We have a 120Mbit sym. Data line at the main location. The traffic on the router is normal.
Does anyone has experiences with the syncronisation of huge sharepoint libraries?
Is there any way to improve?
3 Replies

@Andreas Ratzke 

 

Hi, I have had the exact same experience managing IT for a small company with 15 users.

We have about 450gb of data, 350.00 files that are split up into to 4 libraries but with the biggest one being over 100.000 items. We have 1gb/s fiber connection and our network connection is barely breaking a sweat.

 

-Save a file.

-Wait a few minutes.

-"Uploading 0kb of 0 kb" (no network utilization)

- Waiting 5 minutes up to 1 hour for a simple document or pdf the be in sync. 

Somtimes uploads stall completely. The only way to fix it is for the user to pause/restart onedrive.

 

From what I can read in the documentation there is a performance penalty above 100k files for Onedrive, and also above 350k files for Sharepoint online libraries.

 

Is has been a nightmare from the beginning, and we are still not sure if we will be able to stay with O365 for our files or if we have to find another solution.

 

This problem is not occuring in the regular Onedrive for consumers version.

There is definetly something with sharepoint online that is killing the performance there.

 

I have tried EVERYTHING (does not matter which OS, Onedrive version, network connection/location, filetypes, firewalls).

I have been in contact with MS support, no luck.  No one has even admitted to the problem even existing or have been able to find something wrong in our setup.

 

Right now we are preparing to clean up our data, and move it into two separate sharepoint sites and also into different libraries. This way I am hoping to make the 100k and 300k file limits respectively.

Also differential sync is rolling out not, this might alleviate the problem a little bit, but i doubt is, since it is not the actual download/upload speed that is the bottleneck.

 

Hope you find a solution or get out while you can :) Please let me know.

Thanks for you reply. I'm glad that we are not alone with that problem. But I really want to know if it's a bug or a limitation.
At the moment we are synchronizing all files via ODFB to a Windows Server with an Admin Account and rebuild the similar user right structure there. Really not a best practice.
Hope someone from MS can give us an answer ...