1 2 Previous Next 28 Replies Latest reply on May 16, 2018 8:30 AM by Bill Robinson

Since upgrade to BSA 8.9 HF1, patching seems slow

Mark Casey Jul 12, 2017 1:17 PM

Share This:

I've been getting complaints from some of my users of BSA that patching servers is really slow since our upgrade to 8.9 HF1.

Here is what he is describing:

---Begin Snip

In the setup logs it shows a patch is applied and doesn't apply the next patch for over 30 minutes. Last night took almost 2.5 hours to apply 7 patches to 18 servers for the lower environment. This has been the case for all environments i have patched so far this month.

---End Snip

Let me know what logs and or items you need to have me collect to troubleshoot this further...

Thanks,

Mark

1. Re: Since upgrade to BSA 8.9 HF1, patching seems slow

Bill Robinson Jul 12, 2017 1:21 PM (in response to Mark Casey)

have you set the 'automatic update service' to 'never check for updates' ?

https://bmcsites.force.com/casemgmt/sc_KnowledgeArticle?sfdcid=kA214000000dCmXCAU&type=Solution?
Like Show 0 Likes(0)

Actions
2. Re: Since upgrade to BSA 8.9 HF1, patching seems slow

Mark Casey Jul 12, 2017 1:53 PM (in response to Bill Robinson)

They are currently running patching now, and I checked one server out of the 4 being patched, which is taking a long time, and Windows Update is definitely set in this instance to never scan.

The log for the server through the BSA console isn't updating at all. It says "...Processing Instructions" and then just stops. No updates for almost an hour.

-Mark
Like Show 0 Likes(0)

Actions
3. Re: Since upgrade to BSA 8.9 HF1, patching seems slow

Bill Robinson Jul 12, 2017 1:55 PM (in response to Mark Casey)

Bldeploy log from the target ?
Like Show 0 Likes(0)

Actions
4. Re: Since upgrade to BSA 8.9 HF1, patching seems slow

Mark Casey Jul 12, 2017 2:10 PM (in response to Bill Robinson)
Here is the bldeploy.log from the server, it's still in the process of patching.

-Mark

bldeploy-9c7666182d1f3dba917aabf1b7642c59.log 46.4 K
Like Show 0 Likes(0)

Actions
5. Re: Since upgrade to BSA 8.9 HF1, patching seems slow

Bill Robinson Jul 12, 2017 2:19 PM (in response to Mark Casey)

07/12/17 14:13:42.455 INFO bldeploy - [2][windows6.1-2008-R2-SP1-kb4022722-x64.msu-MS17-06-SO7-en-WINDOWS SERVER 2008 R2 ENTERPRISE (X64)-SP1] [stdout: 2]
C:\temp\stage\49b8b69e531d33909bdad3e6588e5ed4\177522.1>"C:\temp\stage\49b8b69e531d33909bdad3e6588e5ed4\\177522.1\windows6.1-kb4022722-x64.msu" /quiet /norestart
07/12/17 14:49:53.005 INFO bldeploy - [2][windows6.1-2008-R2-SP1-kb4022722-x64.msu-MS17-06-SO7-en-WINDOWS SERVER 2008 R2 ENTERPRISE (X64)-SP1] [stdout: 2]
C:\temp\stage\49b8b69e531d33909bdad3e6588e5ed4\177522.1>SET LASTERR=-2145124322

that looks a lot like the problem w/ windows update being enabled. either that or it's taking 35 min to install this patch.

so what is automatic updates actually set to ? and how are you checking it ? (gpo, registry ?)
Like Show 0 Likes(0)

Actions
6. Re: Since upgrade to BSA 8.9 HF1, patching seems slow

Mark Casey Jul 12, 2017 2:26 PM (in response to Bill Robinson)

I went to the Control Panel > Windows Update and checked in there. It was set to never check for updates, and then I went and stopped and the Windows Update service, set it to manual and restarted it again.

-Mark
Like Show 0 Likes(0)

Actions
7. Re: Since upgrade to BSA 8.9 HF1, patching seems slow

Bill Robinson Jul 18, 2017 8:28 AM (in response to Mark Casey)

did stopping the windows update service make any difference ?
Like Show 0 Likes(0)

Actions
8. Re: Since upgrade to BSA 8.9 HF1, patching seems slow

Mark Casey Jul 24, 2017 2:15 PM (in response to Bill Robinson)

It seemed to "wake it up". Like it was hung, and restarting the service kick started it. If that makes any sense.

-Mark
Like Show 0 Likes(0)

Actions
9. Re: Since upgrade to BSA 8.9 HF1, patching seems slow

Bill Robinson Aug 2, 2017 8:11 AM (in response to Mark Casey)

so after setting the 'never check for updates' and restarting the service do you still have slowness during the deploy ?
Like Show 0 Likes(0)

Actions
10. Re: Since upgrade to BSA 8.9 HF1, patching seems slow

Mark Casey Aug 2, 2017 9:20 AM (in response to Bill Robinson)

The reports I've been getting from admins who are patching seems to be inconsistent... Is there a way to get some input from BSA at to what exactly is happening during the patch window?

I've been monitoring the GUI, and it seems like the real-time log under "Commit" doesn't update until after the job is complete.
Like Show 0 Likes(0)

Actions
11. Re: Since upgrade to BSA 8.9 HF1, patching seems slow

Bill Robinson Aug 2, 2017 1:27 PM (in response to Mark Casey)

it's right there in the bldeploy log:

07/12/17 14:13:42.455 INFO bldeploy - [2][windows6.1-2008-R2-SP1-kb4022722-x64.msu-MS17-06-SO7-en-WINDOWS SERVER 2008 R2 ENTERPRISE (X64)-SP1] [stdout: 2]
C:\temp\stage\49b8b69e531d33909bdad3e6588e5ed4\177522.1>"C:\temp\stage\49b8b69e531d33909bdad3e6588e5ed4\\177522.1\windows6.1-kb4022722-x64.msu" /quiet /norestart
07/12/17 14:49:53.005 INFO bldeploy - [2][windows6.1-2008-R2-SP1-kb4022722-x64.msu-MS17-06-SO7-en-WINDOWS SERVER 2008 R2 ENTERPRISE (X64)-SP1] [stdout: 2]
C:\temp\stage\49b8b69e531d33909bdad3e6588e5ed4\177522.1>SET LASTERR=-2145124322

at 14:13 it ran:
"C:\temp\stage\49b8b69e531d33909bdad3e6588e5ed4\\177522.1\windows6.1-kb4022722-x64.msu" /quiet /norestart

that took 36 min. another place to look is the 'windowsupdate.log' which is in %windir% - that might give another clue about what happens during the msu execution.
Like Show 0 Likes(0)

Actions
12. Re: Since upgrade to BSA 8.9 HF1, patching seems slow

Preetha Gunasekaran Oct 22, 2017 3:59 AM (in response to Mark Casey)

We are also facing similar issue at our Environment post Upgrade to 8.9 SP1. Is there any known issue with patching slowing Down post upgrade.
Like Show 0 Likes(0)

Actions
13. Re: Since upgrade to BSA 8.9 HF1, patching seems slow

Jim Wilson Oct 23, 2017 3:15 AM (in response to Preetha Gunasekaran)

Slowing down where?
What do your logs show?
Have you followed the advice shown above?
If so, I'd suggest this should be a support case
Like Show 0 Likes(0)

Actions
14. Re: Since upgrade to BSA 8.9 HF1, patching seems slow

Mark Casey Oct 24, 2017 12:25 PM (in response to Jim Wilson)
This had come up again, and I've been tracking the incidents better then I did before. Here is what I found:

It doesn't seem to be tied to the Windows Update settings, we've seen the issue with the setting being correct in Control Panel.

Recently had 8 servers all deploying 4 or 5 patches.
4 of the servers finished in 5 to 6 minutes
4 of the servers finished in 248 to 397 minutes
Seems to effect 2008 and 2012
The longest patch for 2012 (kb4040967) took 233 minutes to install (took 30 seconds to install on a "good" server)
The longest patch for 2008 (kb4038779) took 199 minutes to install (took ~2 minutes to install on a "good" server)

We've opened a ticket with Microsoft and I will be opening a support ticket with BMC to investigate this further.
Like Show 0 Likes(0)

Actions