Forum Discussion

Samuel Walker's avatar
Samuel Walker
Brass Contributor
May 20, 2021

Why is upload to Sharepoint so flakey? And is there a workaround?

I've been asked to upload a load of files to a sharepoint site in our comapny.   I've tried a couple of times now, and the process starts OK, but seems to hit a timeout error or something and the w...
files
SharePoint Online
Upload
RobElliott's avatar
RobElliott
Silver Contributor
May 20, 2021

Samuel Walker limit the uploads to batches of no more than 100 files and it shouldn't time out.

 

Rob
Los Gallardos
Intranet, SharePoint, Website and Power Platform Manager (and classic 1967 Morris Traveller driver)

Samuel Walker's avatar
Samuel Walker
Brass Contributor
May 20, 2021

Thanks Rob. I've just checked - the files I've been asked to upload comprise 42,790 files in a (2 level) nested folder structure!

I might be giving this project back to our IT guys!

I can't believe Sharepoint has such flakey file upload functionality though. a 100 file upload limit! Staggering.

  • Paul_HK_de_Jong's avatar
    Paul_HK_de_Jong
    Iron Contributor
    May 20, 2021

    Samuel Walker 

    If you pass the problem to the IT folks then the problem does not go away. They will have the same problems/limitations.

    A. Use browser interface (but limit to 100 items or less)
    B. Use OneDrive for Business client
    C. Use PowerShell scripts

    D. Use 3rd party tools (e.g. https://www.slimapplications.com/wp-content/uploads/2020/05/ExplorerUploadOverview_1Labels.png)
    E. Use Enterprise migration tools or SPMT

    A,B,C and SPMT are free. D and E provide logging and resilience and other features like retaining original modify date and metadata support.

    Using a mapped network drive is not a robust option if you are dealing with a large number of files.

    Paul | SLIM Applications

    • Samuel Walker's avatar
      Samuel Walker
      Brass Contributor
      May 20, 2021
      Thanks a lot for all of these, Paul. That's really helpful. Can you explain more about how to use OneDrive for Business client to get these files onto SharePoint - that sounds like the most promising option for my situation.
      • Paul_HK_de_Jong's avatar
        Paul_HK_de_Jong
        Iron Contributor
        May 20, 2021

        If you just need to get the files uploaded into SharePoint (assuming SharePoint Online) that is indeed the easiest way.

         

        Execute the following steps:
        - open the SharePoint Online library where you want to upload the files
        - in the modern view: click sync
        - open OneDrive for Business client on your local computer (if necessary install, see https://support.microsoft.com/en-us/office/sync-files-with-onedrive-in-windows-615391c4-2bd3-4aae-a42a-858262e42a49#bkmk_install)
        - browse to the location where you want to upload the files
        - copy/move the files to the OneDrive location in File Explorer
        - wait (be patient) for the files to be uploaded to SharePoint Online
        - when all files have been uploaded stop synching (see https://support.microsoft.com/en-us/office/choose-which-onedrive-folders-to-sync-to-your-computer-98b8b011-8b94-419b-aa95-a14ff2415e85)
        - you can now delete the "local" content without affecting the documents in SharePoint

Resources