Error 429 when processing large documentlibrary

Eline_SharePointFAB 

With respect to the HTTP 429 topic within your question, there is no simple answer since an answer will vary depending on the number of licences involved.

As a result, where you're asking if you can load 5,000 documents at a time, we can't say, since the answer will depend on your licencing volume. And beyond whether or not you can load 5,000 in a single request, you then have to factor in how many are you permitted to load within a one minute interval.

You should read about the way throttling works to begin with:

• Avoid getting throttled or blocked in SharePoint Online | Microsoft Learn

Going one step further, you need to be aware of the limitations in relation to throttling of the community-written PnP module:

• What is the best way to deal with HTTP 429 - Throttled - requests with PnP ? · pnp/powershell · Discussion #62 · GitHub

If you were to write your own REST-based implementation, you could leverage the "Retry-After" header data, but you cannot do this using the PnP module.

Cheers,

Lain