General Availability of the SharePoint Migration Tool & SharePoint Migration Assessment Tool Updates
Published Jan 10 2018 04:01 PM 41.3K Views
Microsoft

GENERAL AVAILABILITY TODAY

 

Taking advantage of cloud services doesn’t have to be difficult or a long-phased migration project.  Today we're excited to announce General Availability of the SharePoint Migration Tool, a simple, and fast migration solution to help you migrate content from on-premises SharePoint sites and file shares to SharePoint or OneDrive in Office 365.

 

Based on the learning and experience from Microsoft FastTrack, the SharePoint Migration Tool from Microsoft  was designed to help you bring your information to the cloud and take advantage of the latest collaboration, intelligence, and security solutions with Office 365.

 

With a few simple clicks in the intuitive user interface, you can quickly and easily migrate files from file shares, SharePoint sites, or support bulk migrations.

 

SPMT_Blog.png

 

Whether you’re looking to migrate from file shares on-premises to SharePoint or OneDrive or from on-premises versions of SharePoint, the SharePoint Migration Tool supports the smallest of migrations to large scale migrations with support for bulk scenarios.

 

SharePoint Migration Assessment Tool Updates

In parallel to releasing the SharePoint Migration Tool, we’re also making it easier to ensure your migration is successful by helping you remediate common migration issues before they occur through improvements to the SharePoint Migration Assessment Tool.  Improvements in the latest release include:

 

A Unified Download Package

  • SMAT.exe will determine the version of SharePoint on which it’s installed and run the appropriate tool based on the parameters passed to it. Works on both SharePoint 2010 and SharePoint 2013.

New and Updates Assessment Scans

  • New Assessment Scans
    • Custom Permission Levels. Enumerates and reports on all locations that a custom permission level has been created.
    • External Lists – Enumerates and reports on all external lists (BCS connected) in the environment.
  • Changes to existing assessment scans
    • Default filter added to site language to exclude 1033.
    • Default filter added to Customized Pages to exclude anything under _catalogs.
    • Retry logic added to calls to remote resources such as SQL Server. This will help the scans succeed in environments with suspect connectivity. -r switch  added to command line to enable an operator to specify the number of retries. Default is 3.

Improved Identity Mapping Support

  • Ability to generate a full identity report that provides a comprehensive view of the users and groups that have access to the SharePoint environment and if they were able to be mapped to Azure Active Directory identities.
  • Ability to generate an identity mapping file that can be consumed by SPMT or other tool that can use the SMAT identity mapping format.
  • New identity mapping scans configured in the same scandef.json file as the assessment scans.
    • SharePoint Identity Scanner - Discovers all the users and groups that have access to SharePoint.
    • Active Directory Identity Scanner - If the identities found in SharePoint are Windows accounts, lookup Active Directory information for the users and groups. This data is useful to track down identities that did not have a mapping in Azure Active Directory.
    • Azure Active Directory Identity Scanner - Look up users and groups found in SharePoint in the Azure Active Directory tenant the user logged into. Determine if there is an Exact Match, Partial Match, or No Match.
      • ExactMatch – Windows SID in SharePoint matches the OnPremisesSecurityIdentifier in Azure AD.
      • PartialMatch – Claim value in SharePoint matches UPN or email. Display Name in SharePoint matches Display Name in Azure AD.
      • NoMatch – Unable to find an exact/partial match.

While the SharePoint Migration Tool and SharePoint Migration Assessment Tool provide support for many migration scenarios, we recognize your needs may differ in scope and complexity.  For more complex migrations, support with adoption and usage, or help planning Microsoft FastTrack includes resources, tools, and experts to make your rollout of Office 365 a success.

 

To learn more about Microsoft FastTrack visit https://fasttrack.microsoft.com/office.  In addition, consider one of Microsoft’s many partners that can help ensure your migration to Office 365 is both seamless and successful.

 

Getting Started

To get started and download the new SharePoint Migration Tool from Microsoft visit https://aka.ms/spmt.

 

To get started and download the SharePoint Migration Assessment Tool visit https://aka.ms/smat.

78 Comments
Copper Contributor

@Simon Bourdages

 

thank you

 

I noticed also on the new version that just released, no option to resume.

 

Please update the support reps as well as the document pages explaining that the resume function has been removed (is broken  at the moment)

Microsoft

@Steve Lindsey 

You are correct that we are continuously doing improvement and new releases have been performed. That activity is independent of the Engineering team working on the resume functionality. Our team is still working actively on bringing back to the Migration tool an option for you to resume your previous migration.

Copper Contributor

One can also get some help from here:  https://www.nucleustechnologies.com/sharepoint-migration/

Copper Contributor

@Bill Baer, why not Open-Source this project on GitHub? I realize there's extra management involved, but it would allow the product to evolve more quickly.

Chris

Copper Contributor

Hi,
I have just stumbled upon the SPMT, i feel that i am in luck since it's free compared to a paid solution that just ran out of subscription.
I do see one (maybe two) challenge(s) though with this tool, which i hope someone else have seen and maybe have a solution to.

Background, i am migrating from File Share to OneDrive for business and using a CSV file. (using SPMT v2.1.101.6)
On the VM where i am running this i connect to the local NAS with admin rights to the user folders, SPMT is connected with my O365 Admin account (with MFA) all that is good, i can access user directories and can copy using SPMT.

But two times i have had to restart the migration so far: one time for adding more CPU's to the VM (2 maxed to 100%) and second time it was because the C drive was running out of space, because of the logfiles.

1a. When i start SPMT again, i can chose the old migration job, but all the tasks is failing due to a invalid password, I wonder if this could be because of a saved MFA token? (even though i am prompted and sign in with MFA before choosing the old job)

1.b With the same credentials used, i can start a new migration job, but then it starts all over again, with checking and comparing. but it works


2. Another thing i have noticed is when i run the migration and have forgot to map the local NAS with sufficient rights, SPMT run through the tasks successfully, even though no files are copied, i kinda suspect to get a warning or error to be thrown at me, stating that there isn't access to the folders i am trying to migrate.


Last but not least, thanks for great tool, i am happy about the reporting and POWERSHELL integration!!

Jan

MS-SP-MigrationTool.png

Microsoft

@jvinterberg Thanks for the feedback on SPMT, I'll be sure to bring this to the team to address any potential issues.  I'm glad to see that SPMT has helped to accelerate your journey to Office 365.

 

Bill

Microsoft

@jvinterberg  Thanks for the feedback.  In terms of the issue 1a and 2, Could you please share the logs and reports under C:\Users\%user name%\AppData\Roaming\Microsoft\MigrationTool\admin@XXXX.onmicrosoft.com\WF_XXXXX folder to Migration dev servicing migration_team@microsoft.com? Thank you. 1b is expected. When you re-migrate with the same data source and target, the tool will compare the target data with source and do incremental migration. 

Copper Contributor

Hello,

 

I am getting below error while migrating documents using SPMT. 

 

This is an unexpected exception. Please report to Microsoft with the details. (ErrorCode: 0x0204000D)

 

Log says - "[01/09/2019 11:28:43][0000][48][LOGGING][EXCEPTION]
System.InvalidOperationException: This implementation is not part of the Windows Platform FIPS validated cryptographic algorithms.
at System.Security.Cryptography.MD5CryptoServiceProvider..ctor()
at Microsoft.SharePoint.MigrationTool.MigrationLib.Package.PrimeMetaFile.SaveFile(String manifestOutputFolder)
at Microsoft.SharePoint.MigrationTool.MigrationLib.Common.MIGUtilities.<>c__DisplayClass12.<RunWithRetry>b__11()
at Microsoft.SharePoint.MigrationTool.MigrationLib.Common.MIGUtilities.RunWithRetry[T](Func`1 logicToRetry, Int32 retryCount, Int64 timeOutSeconds, Int32 retryIntervalMiliSeconds, String errorMessage, Type[] retryExceptionTypes, Type[] nonRetryExceptionTypes)"

 

Please help to fix this one.

Microsoft

@Anoop Kv 

Thanks for your feedback. 

Could you please create a support ticket?

Regarding to how to create a support case, it is sort of depends on what kind of support contact you have. The most common type you can do is from the O365 Admin Center under Support.

 

Create a support case via the Office 365 portal: https://portal.office.com/adminportal/home? Select New Service Request from the left menu will be good.  

This might help also https://support.microsoft.com/en-us/gp/support-options-for-business?forceorigin=esmc

I think also maybe this can provide support for those who want to avoid spending money
https://support.microsoft.com/en-us/contactus/

At the same time, could you please share everything under C:\Users\%user name%\AppData\Roaming\Microsoft\MigrationTool\admin@XXXX.onmicrosoft.com\WF_XXXXX folder to Migration dev servicing migration_team@microsoft.com? It will include reports and logs.

Copper Contributor

@Helen Hua

Thanks. Sent the logs details to the email id provided and logged the ticket.. 

 

I tested few scenarios and here is the outcome -

 

1. Tested migration with single file on the library - Worked

    File name : MLD - LB Traffic Flow_SecReview.pdf

 

2. Tested migration with additional sub folder and single file on that folder - Not Working

    Sub folder name: Test2

    File inside sub folder : Test_Doc-1.docx

    File on the root folder : MLD - LB Traffic Flow_SecReview.pdf

 

Not sure why its breaking when we have sub folder. Any idea?

 

Thanks.

Microsoft

@Anoop Kv Please define the sub-folder with CSV or Json if you have a complicated structure for your content migration. In terms of how to define CSV and Json, click  https://docs.microsoft.com/en-us/sharepointmigration/how-to-format-your-csv-file-for-data-content-mi...

Copper Contributor

@Helen Hua Thanks, I tried both ways using direct SharePoint connection setup and CSV. CSV was updated to have library to library migration. 

 

CSV format - https://onpremise site/,Documents,,https://onedrive site/,Documents,

 

Tried again, after relaunching the application, and can't migrate any of the documents (with and without folder). getting the same error.

Microsoft

@Anoop Kv Please submit a support ticket. Support team will guide you how to define a CSV for your content migration. 

Copper Contributor

@Helen Hua Already raised ticket and waiting for someone to reach out.

 

@Simon Bourdages from the above comments, seen that you helped Steve with FIPS related error. Let me know if we can test the same workaround/ fix here?

Copper Contributor

@Helen Huaregarding the issue i mentioned the other day.
1a. apparently it is not all the tasks it is failing on, i just re-ran the task for incremental copy today and noticed that some folders are processed.
the error message from one of those failing is:

TaskID,Message,PendingAction,ExceptionId
"c27f6488-97b0-4503-ac3e-14012d8dfd6a","Invalid credentials","ACTION_STOP","0x0201000C"

Another task from the same job (another folder)

TaskID,Message,PendingAction,ExceptionId
"3df5cd7e-f783-43e0-9ca6-7ddad5f60bb2","Invalid credentials","ACTION_STOP","0x0201000C"

Is this enough or what else would you need?

Microsoft

@jvinterberg 

Thanks for your feedback. 

Could you please create a support ticket?

Regarding to how to create a support case, it is sort of depends on what kind of support contact you have. The most common type you can do is from the O365 Admin Center under Support.

Create a support case via the Office 365 portal: https://portal.office.com/adminportal/home? Select New Service Request from the left menu will be good.  

This might help also https://support.microsoft.com/en-us/gp/support-options-for-business?forceorigin=esmc

I think also maybe this can provide support for those who want to avoid spending money
https://support.microsoft.com/en-us/contactus/

At the same time, could you please share everything under C:\Users\%user name%\AppData\Roaming\Microsoft\MigrationTool\admin@XXXX.onmicrosoft.com\WF_XXXXX folder to Migration dev servicing migration_team@microsoft.com? It will include reports and logs.

Copper Contributor

@Helen Huawhen requesting Help in the portal, (Premier Support entitled) i don't get the option to file a reuest, only by phone or email, is that what you want?

Microsoft

@jvinterberg 

I will double confirm with support team why you got no "New Service Request" from the left menu, please stay tuned.

I believe sending an email is good. 

Copper Contributor

@Helen Huai do get the "New Service request" but when i enter "Sharepoint Migration Tool (SPMT)" in the need help window that opens on the right, it show me a solution, and the option to open a New service request via phone or mail.
Note: I have opened a request via email.

Microsoft

@jvinterberg 

Thanks for updating you have created a ticket via email. Sales team confirmed that the process you went through were correct.

Are you a premier customer? if so, then you can use this: https://support.microsoft.com/en-us/premier. This has a pre-requisite of the user having an Access ID. Access ID enables you to create support cases linked to the customer’s premier contract. For some technologies there are financial implications to creating Premier Cases on Premier Contract.

Microsoft

Are there any further updates regarding SP 2016 support?

Microsoft

@Fokalyva , SP2016 support is on the backlog but no committed date yet. Please add your vote to the UserVoice suggestion at https://sharepoint.uservoice.com/forums/282887-sharepoint-hybrid-and-migration/suggestions/34940332-...

Copper Contributor

So i'm doing a migration from a on-premise file server to a specific teams site and am using a CSV file to do this, since the regular way won't find my actual team site. Anyway, the option to do an incremental check doesn't seem to be in the tool. Is the incremental check only available when migration FROM sharepoint on-premise and not a standard windows file share? The situation I'm in is that we've partially migrated files using mapped drives and OneDrive sync but both options are not very reliable and have a host of other problems we're running into however we have about 80% migration done so I don't want to migrate everything over again. 

Microsoft

@gadgets  sorry to hear that the tool cant find you team site. can you confirm its an sharepoint online team site that you are admin of? how did you format the url?

 

For the incremental question you will be happy to hear that the tool actually always perform and incremental migration so all you have to do is point the tool to the source and destination and the tool will only migrate the difference.  you can read more at https://docs.microsoft.com/en-us/sharepointmigration/how-to-use-the-sharepoint-migration-tool 

Copper Contributor

@Simon Bourdages  So the full URL for our teamsite is https://gadgetscomputers.sharepoint.com/sites/Main/Shared%20Documents/General

 

So if I put in https://gadgetscomputers.sharepoint.com/sites/Main then it shows the Documents folder and will upload directly to that however then the files don't actually show up in the "files" tab for the "Main" team. However they do show up in the "Files" tab on the left hand side. However I can put "General" as a sub-folder in a CSV and it uploads to the correct location.

 

For the incremental, I can confirm that it does NOT do incremental by default as I have run the migration multiple times in a row and each time, it re-uploads the same files and overwrites them. I saw a video on someone using the tool and there was a checkbox for "Incremental Migration" in the options but I don't see that option when doing my migration. 

 

Ideally, I should be able to put our full sharepoint site in there (without /sites/teamName etc...) and it should bring up every team i'm a member of and then allow me to select with library to upload to and sub-folders if they exist, or at least the first sub-folder (general) since this is where the actual files are for that team. 


Microsoft

@gadgets  can you send me a private message so we can investigate the issue you have with incremental.  only the modified files should get uploaded  ( the tool will still scan all the files but shouldnt upload)   

For the mention about your path problem we are aware that one of the limitation of the tool is to be able to select a sub folder in the UX not just in the CSV option. there is also a uservoice tracking this and we are actively tracking this one.  https://sharepoint.uservoice.com/forums/282887-sharepoint-hybrid-and-migration/suggestions/36503032-...

Copper Contributor

Wanted to post this as we had quite an issue with trying to get the SMAT tool on our many TB farm to complete but once we figured it out it ran without issue.  We were getting logon issues but permissions were not the issue.  Turns out, we had a deleted content DB that was still referenced in the DB.  Once we removed the reference using the below cmds our world was back in order.   

 

"Failed to run SQL query"

"Cannot open database"

smatissue1.png

 
Get-SPDatabase| Where{$_.Exists -eq$false} | ForEach{$_.Delete()}
 
smatissue2.png
Copper Contributor

Does SMAT work on scanning SP2016 and SP2019?

Thanks!

Version history
Last update:
‎Apr 28 2018 11:48 AM
Updated by: