The 100 migration batches limit and how to not run into it

Published Apr 19 2019 08:00 AM 21.1K Views

As you might or might not know, in Exchange Online we have an upper limit of 100 migration batches. You can see this limit for MaxNumberOfBatches in the Exchange Online PowerShell Get-MigrationConfig: 100batches (To understand the MaxConcurrentMigrations limit of 300, you can check this blog post written by one of our migration experts, Brad Hughes.) 100 batches created at the same time should be enough for all O365 multi-tenant customers. But, as we have seen in support, sometimes there are support tickets opened because customers would see the error that says: “The maximum number of migration batches is already running. Please remove a batch before you add another one”. The main reason why this number of batches limit is in place is that having more than 100 batches causes performance problems and could cause outages for other customers in the multi-tenant system. Additional reading on resourcing for mailbox moves can be found here. Let’s say that you want to migrate 50,000 mailboxes to Exchange Online: you could create 50 batches with 1000 users each, and you would still have 50 batches available. If you need to complete all the migrations of users from Batch_1 at the same time, you can easily set -CompleteAfter at the migration batch level. Once this batch is completed, you could delete it to create room for another one. In real world, though, we have seen that our customers rarely want to complete large amount of mailbox migrations at the same time. This is usually the reason why large migration batches are not created but rather smaller batches are preferred. That way, all the migrated users from one migration batch at a time can be completed together. In this scenario, our recommendation is to have large batches for initial sync and if you need to complete the migration for users at a separate date, then you would complete the migration for groups of users in smaller batches, as needed. So how would you create small completion batches for already synced users from larger synced batches? Suppose you want to complete migration of users A, B and C, who reached Synced status and they are all contained in a large batch of 1000 users called Batch_1. To do this, first ensure that you have fewer than 100 batches created at the moment:

(Get-MigrationBatch).count

Then, proceed with PowerShell commands to get the users from the larger batch Batch_1 into the new smaller batch CompletionABC. Then complete this smaller batch and optionally, remove the completed migration batch:

New-MigrationBatch -Name CompletionABC -UserIds EmailAddressOfUserA, EmailAddressOfUserB, EmailAddressOfUserC -DisableOnCopy -AutoStart
Complete-MigrationBatch CompletionABC
Remove-MigrationBatch CompletionABC

Another method we sometimes see people using is setting -CompleteAfter on the move requests directly using Set-MoveRequest.  We don't recommend this method because the Migration Service may overwrite the per-request CompleteAfter setting with the one from the batch without notice. This method of individually completing the move requests should only be done when you’ve started the migration through PowerShell, using New-MoveRequest cmdlet, without creating migration batches to contain those move requests. I hope this post gives you a better idea of how to manage migration batches with many users being migrated and not have to run into the limit of number of batches. See you in the cloud! Special thanks to Brad Hughes and Nino Bilic who contributed to this blog post and their precious help in my daily support job. Mirela Buruiana
9 Comments
%3CLINGO-SUB%20id%3D%22lingo-sub-609393%22%20slang%3D%22en-US%22%3EThe%20100%20migration%20batches%20limit%20and%20how%20to%20not%20run%20into%20it%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-609393%22%20slang%3D%22en-US%22%3E%3CP%3EAs%20you%20might%20or%20might%20not%20know%2C%20in%20Exchange%20Online%20we%20have%20an%20upper%20limit%20of%20100%20migration%20batches.%20You%20can%20see%20this%20limit%20for%20MaxNumberOfBatches%20in%20the%20Exchange%20Online%20PowerShell%20Get-MigrationConfig%3A%20%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Flegacyfs%2Fonline%2Fmedia%2F2019%2F04%2F100batches.jpg%22%20target%3D%22_blank%22%3E%3CIMG%20width%3D%22357%22%20height%3D%22163%22%20title%3D%22100batches%22%20style%3D%22border%3A%200px%20currentcolor%22%20alt%3D%22100batches%22%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Flegacyfs%2Fonline%2Fmedia%2F2019%2F04%2F100batches_thumb.jpg%22%20border%3D%220%22%20class%3D%22%22%20%2F%3E%3C%2FA%3E%20(To%20understand%20the%20MaxConcurrentMigrations%20limit%20of%20300%2C%20you%20can%20check%20%3CA%20href%3D%22https%3A%2F%2Fblogs.msdn.microsoft.com%2Fbrad_hughes%2F2017%2F10%2F03%2Funderstanding-migration-concurrency%2F%22%20rel%3D%22noopener%20noreferrer%22%20target%3D%22_blank%22%3Ethis%20blog%20post%3C%2FA%3E%20written%20by%20one%20of%20our%20migration%20experts%2C%20Brad%20Hughes.)%20100%20batches%20created%20at%20the%20same%20time%20should%20be%20enough%20for%20all%20O365%20multi-tenant%20customers.%20But%2C%20as%20we%20have%20seen%20in%20support%2C%20sometimes%20there%20are%20support%20tickets%20opened%20because%20customers%20would%20see%20the%20error%20that%20says%3A%20%E2%80%9C%3CB%3EThe%20maximum%20number%20of%20migration%20batches%20is%20already%20running.%20Please%20remove%20a%20batch%20before%20you%20add%20another%20one%3C%2FB%3E%E2%80%9D.%20The%20main%20reason%20why%20this%20number%20of%20batches%20limit%20is%20in%20place%20is%20that%20having%20more%20than%20100%20batches%20causes%20performance%20problems%20and%20could%20cause%20outages%20for%20other%20customers%20in%20the%20multi-tenant%20system.%20Additional%20reading%20on%20resourcing%20for%20mailbox%20moves%20can%20be%20found%20%3CA%20href%3D%22https%3A%2F%2Fblogs.technet.microsoft.com%2Fexchange%2F2018%2F06%2F25%2Fresource-based-throttling-and-prioritization-in-exchange-online-migrations%2F%22%20rel%3D%22noopener%20noreferrer%22%20target%3D%22_blank%22%3Ehere%3C%2FA%3E.%20Let%E2%80%99s%20say%20that%20you%20want%20to%20migrate%2050%2C000%20mailboxes%20to%20Exchange%20Online%3A%20you%20could%20create%2050%20batches%20with%201000%20users%20each%2C%20and%20you%20would%20still%20have%2050%20batches%20available.%20If%20you%20need%20to%20complete%20all%20the%20migrations%20of%20users%20from%20Batch_1%20at%20the%20same%20time%2C%20you%20can%20easily%20set%20-CompleteAfter%20at%20the%20migration%20batch%20level.%20Once%20this%20batch%20is%20completed%2C%20you%20could%20delete%20it%20to%20create%20room%20for%20another%20one.%20In%20real%20world%2C%20though%2C%20we%20have%20seen%20that%20our%20customers%20rarely%20want%20to%20complete%20large%20amount%20of%20mailbox%20migrations%20at%20the%20same%20time.%20This%20is%20usually%20the%20reason%20why%20large%20migration%20batches%20are%20not%20created%20but%20rather%20smaller%20batches%20are%20preferred.%20That%20way%2C%20all%20the%20migrated%20users%20from%20one%20migration%20batch%20at%20a%20time%20can%20be%20completed%20together.%20In%20this%20scenario%2C%20our%20recommendation%20is%20to%20have%20large%20batches%20for%20initial%20sync%20and%20if%20you%20need%20to%20complete%20the%20migration%20for%20users%20at%20a%20separate%20date%2C%20then%20you%20would%20complete%20the%20migration%20for%20groups%20of%20users%20in%20smaller%20batches%2C%20as%20needed.%20So%20how%20would%20you%20create%20small%20completion%20batches%20for%20already%20synced%20users%20from%20larger%20synced%20batches%3F%20Suppose%20you%20want%20to%20complete%20migration%20of%20users%20A%2C%20B%20and%20C%2C%20who%20reached%20Synced%20status%20and%20they%20are%20all%20contained%20in%20a%20large%20batch%20of%201000%20users%20called%20Batch_1.%20To%20do%20this%2C%20first%20ensure%20that%20you%20have%20fewer%20than%20100%20batches%20created%20at%20the%20moment%3A%3C%2FP%3E%3CP%20class%3D%22code%22%3E(Get-MigrationBatch).count%3C%2FP%3EThen%2C%20proceed%20with%20PowerShell%20commands%20to%20get%20the%20users%20from%20the%20larger%20batch%20Batch_1%20into%20the%20new%20smaller%20batch%20CompletionABC.%20Then%20complete%20this%20smaller%20batch%20and%20optionally%2C%20remove%20the%20completed%20migration%20batch%3A%3CP%20class%3D%22code%22%3ENew-MigrationBatch%20-Name%20CompletionABC%20-UserIds%20EmailAddressOfUserA%2C%20EmailAddressOfUserB%2C%20EmailAddressOfUserC%20-DisableOnCopy%20-AutoStart%3CBR%20%2F%3EComplete-MigrationBatch%20CompletionABC%3CBR%20%2F%3ERemove-MigrationBatch%20CompletionABC%3CBR%20%2F%3E%3C%2FP%3EAnother%20method%20we%20sometimes%20see%20people%20using%20is%20setting%20-CompleteAfter%20on%20the%20move%20requests%20directly%20using%20%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fpowershell%2Fmodule%2Fexchange%2Fmove-and-migration%2Fset-moverequest%3Fview%3Dexchange-ps%22%20rel%3D%22noopener%20noreferrer%22%20target%3D%22_blank%22%3ESet-MoveRequest%3C%2FA%3E.%26nbsp%3B%20We%20don't%20%3CI%3Erecommend%3C%2FI%3E%20this%20method%20because%20the%20Migration%20Service%20may%20overwrite%20the%20per-request%20CompleteAfter%20setting%20with%20the%20one%20from%20the%20batch%20without%20notice.%20This%20method%20of%20individually%20completing%20the%20move%20requests%20should%20only%20be%20done%20when%20you%E2%80%99ve%20started%20the%20migration%20through%20PowerShell%2C%20using%20New-MoveRequest%20cmdlet%2C%20without%20creating%20migration%20batches%20to%20contain%20those%20move%20requests.%20I%20hope%20this%20post%20gives%20you%20a%20better%20idea%20of%20how%20to%20manage%20migration%20batches%20with%20many%20users%20being%20migrated%20and%20not%20have%20to%20run%20into%20the%20limit%20of%20number%20of%20batches.%20See%20you%20in%20the%20cloud!%20Special%20thanks%20to%20Brad%20Hughes%20and%20Nino%20Bilic%20who%20contributed%20to%20this%20blog%20post%20and%20their%20precious%20help%20in%20my%20daily%20support%20job.%20%3CSPAN%20class%3D%22author%22%3EMirela%20Buruiana%3C%2FSPAN%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-611556%22%20slang%3D%22en-US%22%3EAnnouncing%20the%20Release%20of%20the%20Exchange%20Server%202010%20Deployment%20Assistant%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-611556%22%20slang%3D%22en-US%22%3E%3CP%3E%3C%2FP%3E%3CP%3EWe%20heard%20concerns%20from%20our%20early%20adoption%20Exchange%20Server%202010%20customers%20regarding%20transitioning%20from%20Exchange%20Server%202003%20and%2For%20Exchange%20Server%202007%20in%20a%20few%20key%20areas.%20One%20of%20which%20is%20the%20fact%20that%20you%2C%20Exchange%2FIT%20administrators%2C%20are%20burdened%20with%20complex%20migration%20steps%20(multiple%20firewall%20rules%2C%20multiple%20certificates%2C%20multiple%20external%20URLs%2Fports%20for%20clients).%20This%20complexity%20means%20there%20is%20opportunity%20for%20misconfiguration%2C%20which%20causes%20deployments%20to%20stall-not%20to%20mention%20a%20lot%20of%20frustration.%3C%2FP%3E%3CP%3EBased%20on%20this%20feedback%20and%20our%20desire%20to%20help%20streamline%20the%20deployment%20experience%2C%20we%20created%20%3CA%20href%3D%22http%3A%2F%2Ftechnet.microsoft.com%2Fen-us%2Fexdeploy2010%2Fdefault.aspx%22%20rel%3D%22noopener%20noreferrer%22%20target%3D%22_blank%22%3EExchange%20Server%202010%20Deployment%20Assistant%3C%2FA%3E%20which%20can%20be%20accessed%20at%20%3CA%20href%3D%22http%3A%2F%2Ftechnet.microsoft.com%2Fen-us%2Fexdeploy2010%2Fdefault.aspx%22%20rel%3D%22noopener%20noreferrer%22%20target%3D%22_blank%22%3Ehttp%3A%2F%2Ftechnet.microsoft.com%2Fexdeploy2010%3C%2FA%3E%3C%2FP%3E%3CP%3EIt%20allows%20you%20to%20create%20Exchange%202010%20on-premises%20deployment%20instructions%20that%20are%20customized%20to%20your%20environment.%20The%20Assistant%20asks%20a%20small%20set%20of%20questions%2C%20and%20based%20on%20a%20your%20answers%2C%20it%20provides%20a%20finite%20set%20of%20instructions%20that%20are%20designed%20to%20get%20you%20up%20and%20running%20on%20Exchange%202010.%26nbsp%3B%20The%20idea%20is%20that%2C%20instead%20of%20wading%20through%20the%202000%2B%20topics%20in%20the%20Exchange%202010%20library%2C%20you%20can%20answer%20a%20few%20simple%20questions%2C%20and%20the%20Assistant%20gives%20you%20just%20enough%20customized%20content%20to%20do%20the%20upgrade.%3C%2FP%3E%3CP%3EMore%20content%20is%20coming%3A%3CBR%20%2F%3EIn%20this%20version%20of%20the%20Deployment%20Assistant%2C%20content%20is%20available%20for%20customers%20upgrading%20from%20Exchange%202003.%20Additional%20upgrade%20scenarios%20will%20be%20available%20in%20early%202010%20(upgrading%20from%20Exchange%20Server%202007%2C%20or%20a%20mixed%20Exchange%20Server%202003%2F2007%20environment%20for%20example).%20We%20will%20also%20work%20on%20the%20integration%20of%20cross-premise%20scenarios.%3C%2FP%3E%3CP%3EHere%20is%20a%20screenshot%20from%20the%20Assistant%2C%20after%20the%20initial%20set%20of%20questions%20were%20answered%20and%20instructions%20generated.%3C%2FP%3E%3CP%3E%3CA%20href%3D%22https%3A%2F%2Fhelpcenter.xactlycorp.com%2Flegacyfs%2Fonline%2Fmedia%2Fthemes%2Fexchange%2Fimages%2F453170_Deployment_assistant%20pic.jpg%22%20original-url%3D%22%2Fthemes%2Fexchange%2Fimages%2F453170_Deployment_assistant%20pic.jpg%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%20nofollow%22%3E%3CIMG%20src%3D%22http%3A%2F%2Fmigration9.stage.lithium.com%2Fphotos%2Fpostpictures2%2Fimages%2F453170%2F640x428.aspx%22%20border%3D%220%22%20%2F%3E%3C%2FA%3E%3C%2FP%3E%3CP%3EWe%20would%20love%20your%20feedback.%20Prior%20to%20this%20launch%2C%20feedback%20from%20Exchange%20subject%20matter%20experts%20and%20a%20group%20of%20our%20Microsoft%20field%20consultants%20and%20engineers%20who%20work%20with%20you%20every%20day%20was%20incorporated.%26nbsp%3B%20Feel%20free%20to%20leave%20a%20comment%20here%2C%20or%20send%20an%20email%20to%20edafdbk%20AT%20microsoft%20DOT%20com%20via%20the%20'Feedback'%20link%20located%20in%20the%20header%20of%20every%20page%20of%20the%20Deployment%20Assistant.%20Also%2C%20please%20send%20us%20your%20'success%20stories'%20after%20using%20this%20tool...%20we'd%20love%20to%20hear%20about%20them!%3C%2FP%3E%3CP%3E-%3CA%20href%3D%22https%3A%2F%2Fhelpcenter.xactlycorp.com%2Farchive%2F2009%2F06%2F16%2F451628.aspx%22%20rel%3D%22nofollow%20noopener%20noreferrer%22%20target%3D%22_blank%22%3EKatie%20Kivett%3C%2FA%3E%3CBR%20%2F%3EMicrosoft%20Exchange%20Deployment%20Assistant%20PM%3C%2FP%3E%3CP%3E%3CIMG%20src%3D%22https%3A%2F%2Fmail.exchange.microsoft.com%2F14.0.639.21%2Fthemes%2Fbase%2Fclear1x1.gif%22%20width%3D%221%22%20height%3D%221%22%20%2F%3E%3CIMG%20src%3D%22https%3A%2F%2Fmail.exchange.microsoft.com%2F14.0.639.21%2Fthemes%2Fbase%2Fclear1x1.gif%22%20width%3D%221%22%20height%3D%221%22%20%2F%3E%3CIMG%20title%3D%22Message%20history%22%20src%3D%22https%3A%2F%2Fmail.exchange.microsoft.com%2F14.0.639.21%2Fthemes%2Fbase%2Fclear1x1.gif%22%20width%3D%221%22%20height%3D%221%22%20%2F%3E%3C%2FP%3E%3C%2FLINGO-BODY%3E
Version history
Last update:
‎Jul 01 2019 04:36 PM
Updated by: