14 Replies Latest reply: Jun 12, 2012 3:10 PM by Bill Moxim RSS

    Unable to Patch Terminal Servers or Citrix Servers

    David Hawkes

      Windows patching Fails everytime when running it on Terminal Servers and Citrix Boxes. Any ideas why it does this

       

      Command returned non-zero exit code: -2147023728

        • 1. Re: Unable to Patch Terminal Servers or Citrix Servers
          Bill Robinson

          You may need a ‘pre’ command like ‘change user /install’

          • 2. Unable to Patch Terminal Servers or Citrix Servers
            David Hawkes

            Will try that. Got another issue when running the analysis job against Servers, when running it against large amounts of Servers it fails for a high percentage with the following errors

             

            Error while running pre-analysis on server: PMD-DEV-PKG02, Error: JNI fileExists '//host-not-file1//D/Program Files/BMC Software/BladeLogic/8.0/NSH/storage//patch/catalog/catalog_2000121/hfnetchk6b.xml' failed:: Connection refused //host-not-file1//D/Program Files/BMC Software/BladeLogic/8.0/NSH/storage//patch/catalog/catalog_2000121/hfnetchk6b.xml

             

             

            Error while running pre-analysis on server: SGI-NOT-EFPBA01, Error: JNI fileExists '//host-not-file1//D/Program Files/BMC Software/BladeLogic/8.0/NSH/storage//patch/catalog/catalog_2000121/hfnetchk6b.xml' failed:: Error in TLS protocol //host-not-file1//D/Program Files/BMC Software/BladeLogic/8.0/NSH/storage//patch/catalog/catalog_2000121/hfnetchk6b.xml

             

            Its hit and miss everytime.

            • 3. Re: Unable to Patch Terminal Servers or Citrix Servers
              Bill Robinson

              You seem to be continually running into the same error - i have seen the same jni error in many of your posts.

               

              what kind of system is your file server? (vm, physical) 

              how many appservers do you have? 

              when you say "large amounts of servers" how many are you targeting?

              • 4. Re: Unable to Patch Terminal Servers or Citrix Servers
                David Hawkes

                The file Server is running Windows 2003 on Physical tin, I currently have 2 application Servers running BL. I think the last analysis i ran was against a 1000 Servers, with say anything from 10% to 30% failing.

                • 5. Re: Unable to Patch Terminal Servers or Citrix Servers
                  Bill Robinson

                  Either you have some mis-configured ACLs on the file server agent (which we have checked a few times and they seem ok iirc) or your file server agent is flaking out. 

                   

                  is there anything in the rscdsvc.log that indicates the service is restarting alot?

                  • 6. Re: Unable to Patch Terminal Servers or Citrix Servers
                    David Hawkes

                    Can see this

                     

                    03/30/11 13:27:03.399 ERROR    rscdsvc - ManageAgent: Agent being restarted - count=46

                    03/30/11 13:27:05.415 INFO     rscdsvc - HandleAgentStart: Agent process started ("C:\Program Files\BMC Software\BladeLogic\8.0\RSCD/RSCD.exe" -r -R)

                    03/30/11 13:27:20.915 ERROR    rscdsvc -  host-not-file1b 11564 SYSTEM (???): ???: ACNP_Open: No Agent Control Pipe detected, Service manager cannot control agent: The system cannot find the file specified. 

                    03/30/11 13:27:20.915 ERROR    rscdsvc - HandleAgentStart: Agent process may have failed to start, Check for Agent hung processes or Agent resources still in use, consier reboot

                    03/30/11 13:27:20.915 ERROR    rscdsvc - ManageAgent: Agent down hard thread(68)

                    03/30/11 13:27:20.915 ERROR    rscdsvc - ManageAgent: Agent being restarted - count=47

                    03/30/11 13:27:22.915 INFO     rscdsvc - HandleAgentStart: Agent process started ("C:\Program Files\BMC Software\BladeLogic\8.0\RSCD/RSCD.exe" -r -R)

                    03/30/11 13:27:26.712 ERROR    rscdsvc - ManageAgent: Agent down hard thread(68)

                    03/30/11 13:27:26.712 ERROR    rscdsvc - ManageAgent: Agent being restarted - count=48

                    03/30/11 13:27:28.728 INFO     rscdsvc - HandleAgentStart: Agent process started ("C:\Program Files\BMC Software\BladeLogic\8.0\RSCD/RSCD.exe" -r -R)

                    03/30/11 13:27:37.775 ERROR    rscdsvc - ManageAgent: Agent down hard thread(68)

                    03/30/11 13:27:37.791 ERROR    rscdsvc - ManageAgent: Agent being restarted - count=49

                    03/30/11 13:27:39.791 INFO     rscdsvc - HandleAgentStart: Agent process started ("C:\Program Files\BMC Software\BladeLogic\8.0\RSCD/RSCD.exe" -r -R)

                    03/30/11 13:27:58.557 ERROR    rscdsvc - ManageAgent: Agent down hard thread(68)

                    03/30/11 13:27:58.557 ERROR    rscdsvc - ManageAgent: Agent being restarted - count=50

                    03/30/11 13:28:00.557 INFO     rscdsvc - HandleAgentStart: Agent process started ("C:\Program Files\BMC Software\BladeLogic\8.0\RSCD/RSCD.exe" -r -R)

                    03/30/11 13:28:19.104 ERROR    rscdsvc - ManageAgent: Agent down hard thread(68)

                    03/30/11 13:28:19.104 ERROR    rscdsvc - ManageAgent: Agent failed after 50 restarts. Exiting

                    03/30/11 13:28:19.120 INFO     rscdsvc - RSCDsvc::Run: Service stopped

                    03/30/11 14:36:17.271 INFO     rscdsvc - HandleAgentStart: Agent process started ("C:\Program Files\BMC Software\BladeLogic\8.0\RSCD/RSCD.exe")

                    03/30/11 13:27:03.399 ERROR    rscdsvc - ManageAgent: Agent being restarted - count=46

                    03/30/11 13:27:05.415 INFO     rscdsvc - HandleAgentStart: Agent process started ("C:\Program Files\BMC Software\BladeLogic\8.0\RSCD/RSCD.exe" -r -R)

                    03/30/11 13:27:20.915 ERROR    rscdsvc -  host-not-file1b 11564 SYSTEM (???): ???: ACNP_Open: No Agent Control Pipe detected, Service manager cannot control agent: The system cannot find the file specified. 

                    03/30/11 13:27:20.915 ERROR    rscdsvc - HandleAgentStart: Agent process may have failed to start, Check for Agent hung processes or Agent resources still in use, consier reboot

                    03/30/11 13:27:20.915 ERROR    rscdsvc - ManageAgent: Agent down hard thread(68)

                    03/30/11 13:27:20.915 ERROR    rscdsvc - ManageAgent: Agent being restarted - count=47

                    03/30/11 13:27:22.915 INFO     rscdsvc - HandleAgentStart: Agent process started ("C:\Program Files\BMC Software\BladeLogic\8.0\RSCD/RSCD.exe" -r -R)

                    03/30/11 13:27:26.712 ERROR    rscdsvc - ManageAgent: Agent down hard thread(68)

                    03/30/11 13:27:26.712 ERROR    rscdsvc - ManageAgent: Agent being restarted - count=48

                    03/30/11 13:27:28.728 INFO     rscdsvc - HandleAgentStart: Agent process started ("C:\Program Files\BMC Software\BladeLogic\8.0\RSCD/RSCD.exe" -r -R)

                    03/30/11 13:27:37.775 ERROR    rscdsvc - ManageAgent: Agent down hard thread(68)

                    03/30/11 13:27:37.791 ERROR    rscdsvc - ManageAgent: Agent being restarted - count=49

                    03/30/11 13:27:39.791 INFO     rscdsvc - HandleAgentStart: Agent process started ("C:\Program Files\BMC Software\BladeLogic\8.0\RSCD/RSCD.exe" -r -R)

                    03/30/11 13:27:58.557 ERROR    rscdsvc - ManageAgent: Agent down hard thread(68)

                    03/30/11 13:27:58.557 ERROR    rscdsvc - ManageAgent: Agent being restarted - count=50

                    03/30/11 13:28:00.557 INFO     rscdsvc - HandleAgentStart: Agent process started ("C:\Program Files\BMC Software\BladeLogic\8.0\RSCD/RSCD.exe" -r -R)

                    03/30/11 13:28:19.104 ERROR    rscdsvc - ManageAgent: Agent down hard thread(68)

                    03/30/11 13:28:19.104 ERROR    rscdsvc - ManageAgent: Agent failed after 50 restarts. Exiting

                    03/30/11 13:28:19.120 INFO     rscdsvc - RSCDsvc::Run: Service stopped

                    03/30/11 14:36:17.271 INFO     rscdsvc - HandleAgentStart: Agent process started ("C:\Program Files\BMC Software\BladeLogic\8.0\RSCD/RSCD.exe")

                    • 7. Re: Unable to Patch Terminal Servers or Citrix Servers
                      David Hawkes

                      We are currently using a existing file server, which is used for alot of other stuff, would a new file server dedicated to BL fix this issue.

                      • 8. Re: Unable to Patch Terminal Servers or Citrix Servers
                        Jim Campbell

                        I've seen that occur on our fileserver before.  For us, the agent tried to restart at some point but the old process was still there.  The process was still tying up the agent port so the service couldn't restart.  Killing the old process and restarting the agent on the fileserver fixed our problem, but I don't see how anything could even be running if you were still having this problem.

                        • 9. Re: Unable to Patch Terminal Servers or Citrix Servers
                          David Hawkes

                          Tried putting the change user /install as a pre command but patching still failing on Citrix/Termainl servers. Any Ideas.

                          • 10. Re: Unable to Patch Terminal Servers or Citrix Servers
                            Bill Robinson

                            What part of the patch analysis/deploy is failing, and what error are you getting now?

                            • 11. Re: Unable to Patch Terminal Servers or Citrix Servers
                              David Hawkes

                              Its the deploy that is failing

                               

                              Command returned non-zero exit code: -2147023728

                               

                              APPLY failed for server GARD-UAT-TERM01. Exit code = -4001

                              • 12. Re: Unable to Patch Terminal Servers or Citrix Servers
                                Jim Campbell

                                What OS is this?  That looks like a Windows return code we get pretty frequently.  I'm beginning to suspect it occurs from attempting to apply an obsolete patch after the patch which caused it to be obsolete.  If you run a second analysis afterwards, is anything showing as missing?

                                • 13. Re: Unable to Patch Terminal Servers or Citrix Servers
                                  Bill Robinson

                                  The 2147023728 looks like it’s a return code from one of the patches being installed.  if you search the kb, there should be some articles about resolving that.  or open a support case w/ this info and your logs.

                                  • 14. Re: Unable to Patch Terminal Servers or Citrix Servers
                                    Bill Moxim

                                    David, did you ever find a solution to your issue with running an analysis against large groups of servers with a fair percentage failing, where if you run them in smaller sizes you have better luck?  I am having the exact same issue here (among many); but this of course causes our patch jobs to fail and makes it very difficult to get reliable reporting to determine our complaince.  My errors are the same as yours overall on both the rscdsvc.log as well as the job logs.