Hi,
We have a 2 server Exchange 2013 deployment where i updated server 2 from CU2v2 to CU3 without problems. Now the install on server 1 have been running for over 10 hours and hangs/freezes at 98% on step 13 (Mailbox role: Mailbox service).
The server name where the update hangs is "EX1.dom.local".
Here is the last lines from ExchangeSetup.log:
[01-07-2014 11:50:24.0236] [1] Executing: stop-SetupService -ServiceName IISAdmin [01-07-2014 11:50:24.0236] [2] Active Directory session settings for 'stop-SetupService' are: View Entire Forest: 'True', Configuration Domain Controller: 'DC1.dom.local', Preferred Global Catalog: 'DC1.dom.local', Preferred Domain Controllers: '{ DC1.dom.local }' [01-07-2014 11:50:24.0236] [2] User specified parameters: -ServiceName:'IISAdmin' [01-07-2014 11:50:24.0236] [2] Beginning processing stop-SetupService [01-07-2014 11:50:24.0236] [2] Service checkpoint has progressed. Previous checkpoint='0' - Current checkpoint='1'. [01-07-2014 11:50:24.0236] [2] Will wait '10000' milliseconds for the service 'IISAdmin' to reach status 'Stopped'. [01-07-2014 11:50:29.0540] [2] Service 'IISAdmin' successfully reached status 'Stopped on this server while waiting for status change. [01-07-2014 11:50:29.0540] [2] Ending processing stop-SetupService [01-07-2014 11:50:29.0540] [1] Executing: start-SetupService -ServiceName MSExchangeRepl [01-07-2014 11:50:29.0540] [2] Active Directory session settings for 'start-SetupService' are: View Entire Forest: 'True', Configuration Domain Controller: 'DC1.dom.local', Preferred Global Catalog: 'DC1.dom.local', Preferred Domain Controllers: '{ DC1.dom.local }' [01-07-2014 11:50:29.0540] [2] User specified parameters: -ServiceName:'MSExchangeRepl' [01-07-2014 11:50:29.0540] [2] Beginning processing start-SetupService [01-07-2014 11:50:29.0790] [2] [WARNING] Service checkpoint has not progressed. Previous checkpoint='0'- Current checkpoint='0'. [01-07-2014 11:50:29.0790] [2] Previous service status query time is '07-01-2014 12:50:29'. [01-07-2014 11:50:29.0790] [2] Current service status query time is '07-01-2014 12:50:29'. [01-07-2014 11:50:29.0790] [2] Will wait '2000' milliseconds for the service 'MSExchangeRepl' to reach status 'Running'. [01-07-2014 11:50:31.0912] [2] Service 'MSExchangeRepl' failed to reach status 'Running' on this server after waiting for '2000' milliseconds. [01-07-2014 11:50:31.0912] [2] Service checkpoint has progressed. Previous checkpoint='0' - Current checkpoint='1'. [01-07-2014 11:50:31.0912] [2] Will wait '120000' milliseconds for the service 'MSExchangeRepl' to reach status 'Running'. [01-07-2014 11:50:32.0442] [2] Service 'MSExchangeRepl' successfully reached status 'Running on this server while waiting for status change. [01-07-2014 11:50:32.0442] [2] Ending processing start-SetupService [01-07-2014 11:50:32.0442] [1] Executing: start-SetupService -ServiceName MSExchangeDagMgmt [01-07-2014 11:50:32.0442] [2] Active Directory session settings for 'start-SetupService' are: View Entire Forest: 'True', Configuration Domain Controller: 'DC1.dom.local', Preferred Global Catalog: 'DC1.dom.local', Preferred Domain Controllers: '{ DC1.dom.local }' [01-07-2014 11:50:32.0442] [2] User specified parameters: -ServiceName:'MSExchangeDagMgmt' [01-07-2014 11:50:32.0442] [2] Beginning processing start-SetupService [01-07-2014 11:50:32.0614] [2] [WARNING] Service checkpoint has not progressed. Previous checkpoint='0'- Current checkpoint='0'. [01-07-2014 11:50:32.0614] [2] Previous service status query time is '07-01-2014 12:50:32'. [01-07-2014 11:50:32.0614] [2] Current service status query time is '07-01-2014 12:50:32'. [01-07-2014 11:50:32.0614] [2] Will wait '25000' milliseconds for the service 'MSExchangeDagMgmt' to reach status 'Running'. [01-07-2014 11:50:32.0879] [2] Service 'MSExchangeDagMgmt' successfully reached status 'Running on this server while waiting for status change. [01-07-2014 11:50:32.0879] [2] Ending processing start-SetupService [01-07-2014 11:50:32.0879] [1] Executing: if ($RoleIsDatacenter -eq $true) { start-SetupService -ServiceName MSExchangeWatchDog; } [01-07-2014 11:50:32.0879] [1] Executing: Set-InformationStoreService [01-07-2014 11:50:32.0879] [2] Active Directory session settings for 'Set-InformationStoreService' are: View Entire Forest: 'True', Configuration Domain Controller: 'DC1.dom.local', Preferred Global Catalog: 'DC1.dom.local', Preferred Domain Controllers: '{ DC1.dom.local }' [01-07-2014 11:50:32.0879] [2] User specified parameters: [01-07-2014 11:50:32.0879] [2] Beginning processing Set-InformationStoreService [01-07-2014 11:50:32.0879] [2] Ending processing Set-InformationStoreService [01-07-2014 11:50:32.0894] [1] Executing: start-SetupService -ServiceName MSExchangeIS [01-07-2014 11:50:32.0894] [2] Active Directory session settings for 'start-SetupService' are: View Entire Forest: 'True', Configuration Domain Controller: 'DC1.dom.local', Preferred Global Catalog: 'DC1.dom.local', Preferred Domain Controllers: '{ DC1.dom.local }' [01-07-2014 11:50:32.0894] [2] User specified parameters: -ServiceName:'MSExchangeIS' [01-07-2014 11:50:32.0894] [2] Beginning processing start-SetupService [01-07-2014 11:50:33.0160] [2] [WARNING] Service checkpoint has not progressed. Previous checkpoint='0'- Current checkpoint='0'. [01-07-2014 11:50:33.0160] [2] Previous service status query time is '07-01-2014 12:50:33'. [01-07-2014 11:50:33.0160] [2] Current service status query time is '07-01-2014 12:50:33'. [01-07-2014 11:50:33.0160] [2] Will wait '25000' milliseconds for the service 'MSExchangeIS' to reach status 'Running'. [01-07-2014 11:50:34.0751] [2] Service 'MSExchangeIS' successfully reached status 'Running on this server while waiting for status change. [01-07-2014 11:50:34.0751] [2] Ending processing start-SetupService [01-07-2014 11:50:34.0751] [1] Executing (non-critical): Get-MailboxDatabase -Server $RoleFqdnOrName | Update-DatabaseSchema -ErrorAction:SilentlyContinue [01-07-2014 11:50:34.0751] [2] Active Directory session settings for 'Get-MailboxDatabase' are: View Entire Forest: 'True', Configuration Domain Controller: 'DC1.dom.local', Preferred Global Catalog: 'DC1.dom.local', Preferred Domain Controllers: '{ DC1.dom.local }' [01-07-2014 11:50:34.0751] [2] User specified parameters: -Server:'EX1.dom.local' [01-07-2014 11:50:34.0751] [2] Beginning processing Get-MailboxDatabase [01-07-2014 11:50:34.0751] [2] Active Directory session settings for 'Update-DatabaseSchema' are: View Entire Forest: 'True', Configuration Domain Controller: 'DC1.dom.local', Preferred Global Catalog: 'DC1.dom.local', Preferred Domain Controllers: '{ DC1.dom.local }' [01-07-2014 11:50:34.0751] [2] User specified parameters: -ErrorAction:'SilentlyContinue' [01-07-2014 11:50:34.0751] [2] Beginning processing Update-DatabaseSchema [01-07-2014 11:50:34.0766] [2] Searching objects "EX1.dom.local" of type "Server" under the root "$null". [01-07-2014 11:50:34.0782] [2] Previous operation run on domain controller 'DC1.dom.local'. [01-07-2014 11:50:34.0782] [2] Searching objects of type "MailboxDatabase" with filter "$null", scope "SubTree" under the root "ex1". [01-07-2014 11:50:34.0844] [2] Searching objects "MDB1" of type "Database" under the root "$null". [01-07-2014 11:50:34.0860] [2] Previous operation run on domain controller 'DC1.dom.local'. [01-07-2014 11:50:34.0860] [2] Processing object "MDB1". [01-07-2014 11:50:34.0907] [2] Opening the Cluster Database on server 'EX2.dom.local'. [01-07-2014 11:51:56.0324] [2] Couldn't connect to the cluster service on server 'EX2.dom.local'. Error: An Active Manager operation failed. Error: An error occurred while attempting a cluster operation. Error: Cluster API '"IsInstalled(EX2.dom.local) failed with 0x6bb. Error: The RPC server is too busy to complete this operation"' failed. [01-07-2014 11:51:56.0340] [2] Couldn't connect to the cluster service on server 'EX2.dom.local'. Error: An Active Manager operation failed. Error: An error occurred while attempting a cluster operation. Error: Cluster API '"IsInstalled(EX2.dom.local) failed with 0x6bb. Error: The RPC server is too busy to complete this operation"' failed. [01-07-2014 11:51:56.0355] [2] Searching objects "MDB2" of type "Database" under the root "$null". [01-07-2014 11:51:56.0371] [2] Previous operation run on domain controller 'DC1.dom.local'. [01-07-2014 11:51:56.0371] [2] Processing object "MDB2". [01-07-2014 11:51:56.0371] [2] Opening the Cluster Database on server 'EX2.dom.local'. [01-07-2014 11:53:17.0539] [2] Couldn't connect to the cluster service on server 'EX2.dom.local'. Error: An Active Manager operation failed. Error: An error occurred while attempting a cluster operation. Error: Cluster API '"IsInstalled(EX2.dom.local) failed with 0x6bb. Error: The RPC server is too busy to complete this operation"' failed. [01-07-2014 11:53:17.0539] [2] Couldn't connect to the cluster service on server 'EX2.dom.local'. Error: An Active Manager operation failed. Error: An error occurred while attempting a cluster operation. Error: Cluster API '"IsInstalled(EX2.dom.local) failed with 0x6bb. Error: The RPC server is too busy to complete this operation"' failed. [01-07-2014 11:53:17.0555] [2] Searching objects "MDB3" of type "Database" under the root "$null". [01-07-2014 11:53:17.0571] [2] Previous operation run on domain controller 'DC1.dom.local'. [01-07-2014 11:53:17.0571] [2] Processing object "MDB3". [01-07-2014 11:53:17.0586] [2] Opening the Cluster Database on server 'EX2.dom.local'. [01-07-2014 11:54:38.0804] [2] Couldn't connect to the cluster service on server 'EX2.dom.local'. Error: An Active Manager operation failed. Error: An error occurred while attempting a cluster operation. Error: Cluster API '"IsInstalled(EX2.dom.local) failed with 0x6bb. Error: The RPC server is too busy to complete this operation"' failed. [01-07-2014 11:54:38.0804] [2] Couldn't connect to the cluster service on server 'EX2.dom.local'. Error: An Active Manager operation failed. Error: An error occurred while attempting a cluster operation. Error: Cluster API '"IsInstalled(EX2.dom.local) failed with 0x6bb. Error: The RPC server is too busy to complete this operation"' failed. [01-07-2014 11:54:38.0835] [2] Searching objects "MDB4" of type "Database" under the root "$null". [01-07-2014 11:54:38.0835] [2] Previous operation run on domain controller 'DC1.dom.local'. [01-07-2014 11:54:38.0835] [2] Processing object "MDB4". [01-07-2014 11:54:38.0851] [2] Opening the Cluster Database on server 'EX2.dom.local'.
Last lines from the install PS file (Install-MailboxRole-20140107-12432602101542918975.ps1):
# Tasks for 'Mailbox Service Control (Last)' component # [ID = MailboxServiceControlLast___9b519a96ed1b4642943e73d663e83ae6, Wt = 1, isFatal = True] "Starting mailbox services." 07-01-2014 12:50:24:add-firewallexception -BinaryPath ($RoleInstallPath + "\bin\Microsoft.Exchange.Store.Service.exe") -Name "MSExchangeIS" # [ID = MailboxServiceControlLast___4e2af99866444e169a1fa7de3f38fef2, Wt = 1, isFatal = True] "Starting mailbox services." 07-01-2014 12:50:24:add-firewallexception -BinaryPath ($RoleInstallPath + "\bin\Microsoft.Exchange.Worker.exe") -Name "MSExchangeIS" # [ID = MailboxServiceControlLast___c9eebc4c26af403da4281d1a0d806dd2, Wt = 1, isFatal = True] "Starting mailbox services." 07-01-2014 12:50:24:remove-firewallexception -BinaryPath ($RoleInstallPath + "\bin\mad.exe") -Name "MSExchangeSA" # [ID = MailboxServiceControlLast___cff4203078c84dd98769ec8916e85e92, Wt = 1, isFatal = True] "Stopping the IIS Admin service." 07-01-2014 12:50:24:stop-SetupService -ServiceName IISAdmin # [ID = MailboxServiceControlLast___a271ef5b83e54536b58f1d4da875d41d, Wt = 1, isFatal = True] "Starting Microsoft Exchange Replication service" 07-01-2014 12:50:29:start-SetupService -ServiceName MSExchangeRepl # [ID = MailboxServiceControlLast___2BE75C4DA081420B9B78009DB6C8CDFA, Wt = 1, isFatal = True] "Starting Microsoft Exchange DAG Management service" 07-01-2014 12:50:32:start-SetupService -ServiceName MSExchangeDagMgmt # [ID = MailboxServiceControlLast___4C591A397F424D56BAFD640209AE7B07, Wt = 1, isFatal = True] "Starting Microsoft Exchange Watchdog service" 07-01-2014 12:50:32: if ($RoleIsDatacenter -eq $true) { start-SetupService -ServiceName MSExchangeWatchDog; } # [ID = MailboxServiceControlLast___17b338d58d8f4ac3abdac7578d4320a3, Wt = 1, isFatal = True] "Setup is configuring the Information Store service." 07-01-2014 12:50:32:Set-InformationStoreService # [ID = MailboxServiceControlLast___2ed283997a7c481ea45da530c5f608e9, Wt = 6, isFatal = True] "Starting Microsoft Exchange Information Store service" 07-01-2014 12:50:32:start-SetupService -ServiceName MSExchangeIS # [ID = MailboxServiceControlLast___d244221b06e5449280c2fa2bcba262f8, Wt = 1, isFatal = False] "Starting mailbox services." 07-01-2014 12:50:34:Get-MailboxDatabase -Server $RoleFqdnOrName | Update-DatabaseSchema -ErrorAction:SilentlyContinue
What do i do now?