2 Replies Latest reply on Dec 9, 2015 5:38 AM by Yanick Girouard

    Upgrading BSA 8.5 SP1 RHEL 7 agents with BSA 8.7 Agent Installer Job ?

    Yanick Girouard

      I tried upgrading a RHEL 7 agent at version 8.5 SP1 to version 8.7 using an agent installer job in BSA 8.7, and it failed miserably:

       

      Info30-Nov-2015 10:32:52 AMThe agent is already installed on 'slbsaportald1'
      Info30-Nov-2015 10:32:52 AMInitiating agent upgrade.
      Info30-Nov-2015 10:32:57 AMThe agent version detected on the target is '8.5.1.304'
      Info30-Nov-2015 10:32:57 AMThe Operating System of target server is : 'Linux 64-bit'.
      Info30-Nov-2015 10:32:57 AMThe installation software picked from agent bundle is : 'RSCD87-LIN64.rpm'.
      Info30-Nov-2015 10:33:04 AMStaging the agent installer, upgrade script and required (if any) configuration files to target servers staging directory : '/bsatmp'.
      Info30-Nov-2015 10:33:16 AMChecking if installer file already exists in //slbsaportald1/bsatmp/5850_8c7b931c-84a0-4fae-818a-585ab7f93301/
      Info30-Nov-2015 10:33:17 AMRSCD87-LIN64.rpm does not exists.
      Info30-Nov-2015 10:33:17 AMEnsuring required disk space exists
      Info30-Nov-2015 10:33:19 AMRequired disk space is available on target machine
      Info30-Nov-2015 10:33:20 AMCopying installer from //snbsafsd1/d/Bladelogic/fsroot/installables/2077837.1/RSCD87-LIN64.rpm to //slbsaportald1/bsatmp/5850_8c7b931c-84a0-4fae-818a-585ab7f93301/
      Info30-Nov-2015 10:35:01 AMInstaller copied successfully.
      Info30-Nov-2015 10:35:01 AMCopying config files from /D/Program Files/BMC Software/BladeLogic/NSH/tmp/application_server/e0b2589e-04fe-4258-b668-0b93d9fd290f to //slbsaportald1/bsatmp/5850_8c7b931c-84a0-4fae-818a-585ab7f93301/
      Info30-Nov-2015 10:35:02 AMConfiguration files copied successfully.
      Info30-Nov-2015 10:35:02 AMGranting execute permissions on installer and upgrade script
      Info30-Nov-2015 10:35:02 AMGranted execute permissions to files successfully.
      Info30-Nov-2015 10:35:02 AMStaging completed successfully.
      Info30-Nov-2015 10:35:05 AMLaunching script for upgrading an Agent.
      Info30-Nov-2015 10:35:09 AMLaunched the upgrade script successfully.
      Info30-Nov-2015 10:35:09 AMAgent is still running. Waiting for agent to go down.
      Info30-Nov-2015 10:35:19 AMAgent is still running. Waiting for agent to go down.
      Info30-Nov-2015 10:35:29 AMAgent is still running. Waiting for agent to go down.
      Info30-Nov-2015 10:35:39 AMAgent is still running. Waiting for agent to go down.
      Info30-Nov-2015 10:35:49 AMAgent is still running. Waiting for agent to go down.
      Info30-Nov-2015 10:35:59 AMAgent is still running. Waiting for agent to go down.
      Info30-Nov-2015 10:36:09 AMAgent is still running. Waiting for agent to go down.
      Info30-Nov-2015 10:36:19 AMAgent is still running. Waiting for agent to go down.
      Info30-Nov-2015 10:36:29 AMAgent is still running. Waiting for agent to go down.
      Info30-Nov-2015 10:36:39 AMAgent is still running. Waiting for agent to go down.
      Info30-Nov-2015 10:36:49 AMAgent is still running. Waiting for agent to go down.
      Info30-Nov-2015 10:36:59 AMAgent is still running. Waiting for agent to go down.
      Warning30-Nov-2015 10:37:09 AMAgent did not stop in stipulated time period. Agent upgrade may have failed. Possible causes can be:

      1. You were trying to install same version of agent as existing

      2. There was not enough space for installer to get extracted / installed

      3. Conflicting BSA component such as NSH is already installed

      4. Reboot is pending on target server (Windows only)

      5. The Agent upgrade is still in progress and needs more time to complete. If this is the case, either run USP job later against the target or contact BSA administrator to increase the waiting time and re-run the job again

      6. An unknown error has occurred. Please refer further job run logs and //slbsaportald1/bsatmp/5850_8c7b931c-84a0-4fae-818a-585ab7f93301//AgentUpgrade.log for more details

      Info30-Nov-2015 10:37:09 AM--- Upgrade Logs ---
      Info30-Nov-2015 10:37:09 AMStarting the agent upgrade
      Info30-Nov-2015 10:37:09 AMUpgrade Command is : rpm -Uiv ./RSCD87-LIN64.rpm
      Info30-Nov-2015 10:37:09 AMPreparing packages...
      Info30-Nov-2015 10:37:09 AMLegacy installation located at /opt/bmc/bladelogic/RSCD
      Info30-Nov-2015 10:37:09 AMPreparing upgrade for RSCD Agent version 8.5.01.304 ...
      Info30-Nov-2015 10:37:09 AMBacking up config files ...
      Info30-Nov-2015 10:37:09 AMContinuing with RSCD installation in /opt/bmc/bladelogic...
      Info30-Nov-2015 10:37:09 AMBladeLogic_RSCD_Agent-8.7.00-239.x86_64
      Info30-Nov-2015 10:37:09 AMRestoring local installation config files
      Info30-Nov-2015 10:37:09 AMConfiguring RSCD Agent in /opt/bmc/bladelogic ...
      Info30-Nov-2015 10:37:09 AM============== Stopping RSCD Agent (if running) ==============
      Info30-Nov-2015 10:37:09 AM... Done
      Info30-Nov-2015 10:37:09 AM============== Setting Up Operating Environment ==============
      Info30-Nov-2015 10:37:09 AM... Done
      Info30-Nov-2015 10:37:09 AM===================== Configuring Logging ====================
      Info30-Nov-2015 10:37:09 AM... Done
      Info30-Nov-2015 10:37:09 AM=============== Installing the Shared Libraries ==============
      Info30-Nov-2015 10:37:09 AM... Done
      Info30-Nov-2015 10:37:09 AM============= Configuring Random Number Device ============
      Info30-Nov-2015 10:37:09 AM... Done
      Info30-Nov-2015 10:37:09 AM================= Installing Agent Component =================
      Info30-Nov-2015 10:37:09 AM... Done
      Info30-Nov-2015 10:37:09 AM===================== Starting the Agent =====================
      Info30-Nov-2015 10:37:09 AM... Done
      Info30-Nov-2015 10:37:09 AM=================== Installation Complete ====================
      Info30-Nov-2015 10:37:09 AMThe installation is complete. You are now ready to begin using
      Info30-Nov-2015 10:37:09 AMBMC BladeLogic Server Automation software.
      Info30-Nov-2015 10:37:09 AMFor support please e-mail us at customer_support@bmc.com
      Info30-Nov-2015 10:37:09 AMDone
      Info30-Nov-2015 10:37:09 AMBladeLogic_RSCD_Agent-8.5.01-304.x86_64
      Info30-Nov-2015 10:37:09 AMwarning: file /opt/bmc/bladelogic/RSCD/bin/openssl: remove failed: No such file or directory
      Info30-Nov-2015 10:37:09 AMAgent upgrade completed successfully
      Info30-Nov-2015 10:37:09 AMRSCD service is already running
      Info30-Nov-2015 10:37:09 AMCopying users file...
      Info30-Nov-2015 10:37:09 AMusers file copied successfully.
      Info30-Nov-2015 10:37:09 AM

      --- End of Upgrade Logs ---

       

      The log says it completed something, and on the server, the BSA 8.7 RPM is showing as installed, but there seems to be a lot of files missing and the systemctl stop rscd command doesn't kill the rscd processes running.

       

      I had to manually nuke the install, remove the 8.7 Rpm (the 8.5 one was gone) and reinstall fresh using the 8.7 RPM. During the uninstall of the rpm, I got a ton of warnings like these (my scrollback buffer was too small to copy the whole thing...):

       

      warning: file /opt/bmc/bladelogic/RSCD/files/secure: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/files/rscdfiles.reg: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/files/rscdfiles.lnk: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/files/rscdfiles.dir: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/files/removefiles.reg: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/files/removefiles.dir: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/files/log4crc.txt: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/files/log4crc.internal.txt: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/files/localefiles.reg: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/files/localefiles.dir: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/files/exports: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/files/cmds: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/daal/Implementation/SystemInfo_libdaalpluginsysinfo.so/libdaalpluginsysinfo.so: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/daal/Implementation/PackageTrackingRoot_libdaalpluginpackagetracking.so/libdaalpluginpackagetracking.so: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/daal/Implementation/ExternalProgramAdapter/libdaalextprogadapter.so: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/daal/Implementation/BMC_UnixUsers_libdaalpluginunixuser.so/libdaalpluginunixuser.so: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/daal/Implementation/BMC_UnixProcesses_libdaalpluginunixprocess.so/libdaalpluginunixprocess.so: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/daal/Implementation/BMC_UnixGroups_libdaalpluginunixgroup.so/libdaalpluginunixgroup.so: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/daal/Implementation/BMC_UnixDaemons_libdaalpluginunixdaemon.so/libdaalpluginunixdaemon.so: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/daal/DAALRegistry.xml: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/bin/update: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/bin/rscd_full: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/bin/nshopt: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/bin/lsof: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/bin/daalinfo: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/bin/cabextract: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/bin/blquery: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/bin/bl_ssl_agent: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/bin/bl_gen_rand: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/bin/actl: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/_uninst/pseudo.locale.tokens: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/_uninst/in_locale.zh: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/_uninst/in_locale.jp.euc_JP: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/_uninst/in_locale.fr.CP1252: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/_uninst/in_locale.en.CP1252: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/_uninst/DAALRegistry-83.xml: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/_uninst/DAALRegistry-83.HP-UX.xml: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/_uninst/DAALRegistry-82.xml: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/_uninst/DAALRegistry-82.HP-UX.xml: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/_uninst/DAALRegistry-81.xml: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/_uninst/DAALRegistry-81.HP-UX.xml: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/_uninst/DAALRegistry-80.xml: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/_uninst/DAALRegistry-80.HP-UX.xml: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/_uninst/DAALRegistry-77.xml: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/_uninst/DAALRegistry-77.HP-UX.xml: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/_uninst/DAALRegistry-76.xml: remove failed: No such file or directory

      warning: file /opt/bmc/bladelogic/RSCD/_uninst/DAALRegistry-76.HP-UX.xml: remove failed: No such file or directory

       

      I thought the upgrade worked well starting with 8.5 SP1 ? Are there known issues ?

       

      This was a freshly built server and the admin installed the 8.5 SP1 agent on it...