Forum Discussion

Roger Seekell's avatar
Roger Seekell
Copper Contributor
Nov 23, 2021
Solved

What's the best way to transfer 4TB of files to SharePoint Online site?

I have nearly 4TB of assorted files on a drive to upload to a SharePoint Online site.  What's the best/fastest way to upload all these files?  (Hopefully, it doesn't involve a paid third-party product. )  Thanks!

9 Replies

  • Ed_Harrington's avatar
    Ed_Harrington
    Copper Contributor

    The problem is the use of local temp storage by the SPMT. I have the smallest folder that contains 60GB of data and the available free space on the system is 50GB. So the process runs out of temp space and gets an error. Any suggestions??

      • Maggan Wåhlin's avatar
        Maggan Wåhlin
        Iron Contributor
        You might need to think about how you want to organize your files. In this case you might want to have multiple sites, which can be a good choice if you need to apply specific permissions to files in your current folders. Example architecture:

        Department X folders goes into SharePoint site "Department X" - only members of Department X have access.
        Department Y folders goes into SharePoint site "Department Y" - only members of Department Y have access.
        Shared documents goes inte SharePoint site "Company documents" - all members of the company have access.
        And so on...

        Then you can connect all sites together using the Hub site feature. This allows for a shared search experience, design theme and navigation.

        Read more about how to manage large lists and libraries here: https://support.microsoft.com/en-us/office/manage-large-lists-and-libraries-b8588dae-9387-48c2-9248-c24122f07c59

    • RobElliott's avatar
      RobElliott
      Silver Contributor

      Maggan Wåhlin for a site with 4TB? That would take forever with the SMT!

       

      Rob
      Los Gallardos
      Intranet, SharePoint and Power Platform Manager (and classic 1967 Morris Traveller driver)

       

       

      • Maggan Wåhlin's avatar
        Maggan Wåhlin
        Iron Contributor

        Well, of course you will need a plan. I´m not saying uploading ALL files at once would be the best approach. It´s possible to use PowerShell (PnP for example), but the same issue will persist with this size... Do you have any suggestions?

Resources