Forum Discussion
How to Export SharePoint list with over 5000 records to excel
Do you want to export it one time only? If yes then you can use below PowerShell script to export list items into CSV.
Below script is using PnP.PowerShell Module so you need to install it before using it.
https://pnp.github.io/powershell/articles/installation.html
Make sure that you update few variables added in MainProcess function i.e. $siteUrl, $listUrl and $outputFilePath
Function GetAllListItems($ctx,$listUrl)
{
#Get the List
$List = $Ctx.Web.GetList($ctx.Web.ServerRelativeUrl + "/" + $listUrl)
$Ctx.Load($List)
$Ctx.ExecuteQuery()
#Define Query to get List Items in batch
$Query = New-Object Microsoft.SharePoint.Client.CamlQuery
$Query.ViewXml = @"
<View Scope='RecursiveAll'>
<Query>
<OrderBy><FieldRef Name='ID' Ascending='TRUE'/></OrderBy>
</Query>
<RowLimit Paged="TRUE">5000</RowLimit>
</View>
"@
$allListItems = @()
#Get List Items in Batch
Do
{
$ListItems = $List.GetItems($Query)
$Ctx.Load($ListItems)
$Ctx.ExecuteQuery()
#$ListItems.count
$Query.ListItemCollectionPosition = $ListItems.ListItemCollectionPosition
foreach($listItem in $ListItems)
{
$allListItems += $listItem
}
}
While($Query.ListItemCollectionPosition -ne $null)
Return $allListItems
}
Function MainProcress()
{
$siteUrl = "https://contoso.sharepoint.com/sites/template"
$listUrl = "Lists/TESTList"
$outputFilePath = "D:\exportedlist.csv"
$includeHiddenField = $False
$includeReadonlyField = $False
Connect-PnPOnline -Url $siteUrl -Interactive
$ctx = Get-PnPContext
$ctx.Load($ctx.Web)
$ctx.ExecuteQuery()
$listFields = Get-PnPField -List $listUrl |? { $_.Hidden -eq $includeHiddenField -AND $_.ReadOnlyField -eq $includeReadonlyField} | Select -ExpandProperty internalname
$count = 0
$listItems= GetAllListItems -ctx $ctx -listUrl $listUrl
$listItems.Count
$hashTable=@()
# Loop through the list items
foreach($listItem in $listItems)
{ $count = $count+1
Write-Progress -Activity "Exporting" -Status "$($count/$listItems.Count*100)% Complete:" -PercentComplete $($count/$listItems.Count*100)
$obj=New-Object PSObject
$listItem.FieldValues.GetEnumerator() | Where-Object { $_.Key -in $listFields }| ForEach-Object{
if($_.Value.LookupValue){$obj | Add-Member Noteproperty $_.Key $_.Value.LookupValue}
else{$obj | Add-Member Noteproperty $_.Key $_.Value}
}
$hashTable+=$obj;
$obj=$null;
}
$hashtable | export-csv $outputFilePath -NoTypeInformation
}
MainProcress
Reference Links used for this script:
Hope it will helpful to you and if so then please mark this as best response and like this answer for better reach of your question to other people.
@kalpeshvaghela Seems this needs an administrator account to run, I am the creator of the list and the site on SharePoint but it asks for an admin account.
Is there a way to overcome this issue?
- kalpeshvaghelaSep 05, 2022Iron Contributor
As this script is using PnP.PowerShell, it will require one time consent which can be done by Global Admin User Only.
See Authentication steps here.
If it's not possible for you then you need to convert this script to only CSOM PowerShell
Hope it will helpful to you and if so then Please mark my response as Best Response & Like to help others in this community
- michael1900Jan 12, 2023Copper Contributor
kalpeshvaghela Hi Sir , I try to copy ur code and modify and run in powershell but got below error :
Do you mind to help me to change the code , i really need it .
my site URL : https://danny520.sharepoint.com/sites/teamssites
List Name: https://danny520.sharepoint.com/sites/teamssites/Lists/list3/AllItems.aspx
Really appreciated for your help.