Forum Discussion
Transfer 1 million rows to Sharepoint list
- Jun 07, 2023
Hi Prasanna_30
firstly, this should work with PnP Powershell and the "Add-PnPListItem" Command (https://pnp.github.io/powershell/cmdlets/Add-PnPListItem.html)
Just call the following command a million timesAdd-PnPListItem -List "Demo List" -Values @{"Title" = "Test Title"; "Category"="Test Category"}(But wait a few seconds every 100 items or so to make sure that you don't get throttled).
Secondly, DON'T DO THIS.SharePoint is not a Database. It can handle that much data, but is not build for that. You will have problems later while acessing the data (i.e. just being able to download at max. 5000 elements per call and massive problems filtering your data if you did not set your indexes perfectly).
If you are using SharePoint Online then try to use a Dataverse table instead
https://learn.microsoft.com/en-us/power-apps/maker/data-platform/data-platform-intro
Best Regards,
Sven
Hi Prasanna_30
firstly, this should work with PnP Powershell and the "Add-PnPListItem" Command (https://pnp.github.io/powershell/cmdlets/Add-PnPListItem.html)
Just call the following command a million times
Add-PnPListItem -List "Demo List" -Values @{"Title" = "Test Title"; "Category"="Test Category"}(But wait a few seconds every 100 items or so to make sure that you don't get throttled).
Secondly, DON'T DO THIS.
SharePoint is not a Database. It can handle that much data, but is not build for that. You will have problems later while acessing the data (i.e. just being able to download at max. 5000 elements per call and massive problems filtering your data if you did not set your indexes perfectly).
If you are using SharePoint Online then try to use a Dataverse table instead
https://learn.microsoft.com/en-us/power-apps/maker/data-platform/data-platform-intro
Best Regards,
Sven
TThere is an easy way for that. Just use my description here:
https://lehmann.ws/2023/04/24/dynamic_10k_data_-sync_to_sharepoint
It's a trick with virtual tables. Easy to build, I would say in 5-10 minutes and then just wait until the import is ready.