2 Replies Latest reply on Aug 21, 2015 1:15 AM by Avikal Jain

    Error during execution of AIX patching job.

    Avikal Jain

      Hello experts,

       

      I am recieving an error during patching of an AIX server, wondering if someone can assist what might have been going wrong. Here's the deploy job log:

       

      Info         20-Aug-2015 09:59:12       Deploy Apply Job (Pre-Execute):AIX 7.1 Remediation Job-server02a-18091 @ 2015-08-20 09-58-11-290+0100; Server:server02a;  PkgID:"0357b308-64d3-4655-b28d-d59e8766c598-1816.1"; UUID:5249e0494f1636a899e7c928d1a3ce92                           

      Info         20-Aug-2015 09:59:12       Started running the deploy step job 'AIX 7.1 Remediation Job-server02a-18091 @ 2015-08-20 09-58-11-290+0100->AIX 7.1 Remediation Job-server02a-18091 @ 2015-08-20 09-58-11-290+0100' on application server 'e-tw1021'(1) against target server 'server02a'                              

      Info         20-Aug-2015 09:59:20       Package "AIX 7.1 Remediation Job-18091 @ 2015-08-20 09-58-10-446+0100" UUID(5249e0494f1636a899e7c928d1a3ce92) started                            

      Info         20-Aug-2015 09:59:25       Package "AIX 7.1 Remediation Job-18091 @ 2015-08-20 09-58-10-446+0100" UUID(5249e0494f1636a899e7c928d1a3ce92) initialized, entering wait queue for processing                      

      Info         20-Aug-2015 09:59:25       Package "AIX 7.1 Remediation Job-18091 @ 2015-08-20 09-58-10-446+0100" UUID(5249e0494f1636a899e7c928d1a3ce92) processing instructions                               

      Info         20-Aug-2015 09:59:32       Package "AIX 7.1 Remediation Job-18091 @ 2015-08-20 09-58-10-446+0100" UUID(5249e0494f1636a899e7c928d1a3ce92) auto-rollback on failure started                 

      Info         20-Aug-2015 09:59:35       Package "AIX 7.1 Remediation Job-18091 @ 2015-08-20 09-58-10-446+0100" UUID(5249e0494f1636a899e7c928d1a3ce92) completed. exitCode = -4001 (Apply failed; auto-rollback successful)                            

      Info         20-Aug-2015 09:59:40       Deployment job not in single-job mode. Reboot and single-user mode is not allowed

      (Time in agent's deploy log:: 08/20/2015 08:59:15)                   

      Info         20-Aug-2015 09:59:40       Bldeploy "AIX 7.1 Remediation Job-18091 @ 2015-08-20 09-58-10-446+0100" UUID(5249e0494f1636a899e7c928d1a3ce92) started using file /var/tmp/stage/8623f09751f030ef83eb8134b59f93c3/bldeploy.xml with rollback directory /opt/bmc/bladelogic/RSCD/Transactions/5249e0494f1636a899e7c928d1a3ce92

      (Time in agent's deploy log:: 08/20/2015 08:59:24)                   

      Info         20-Aug-2015 09:59:40       Starting apply

      (Time in agent's deploy log:: 08/20/2015 08:59:24)                   

      Info         20-Aug-2015 09:59:40       Processing asset BLPACKAGE (Time in agent's deploy log:: 08/20/2015 08:59:24)                           

      Info         20-Aug-2015 09:59:40       Processing asset FILESETGROUP (Time in agent's deploy log:: 08/20/2015 08:59:24)      1              New FileSet Group

      Info         20-Aug-2015 09:59:40       Using URL nfs://server01a.uk.company.com/mksysb/Downloads/AIX/AIX71000206/printers.rte.7.1.2.18_2fde8ad286fdc092f1bcdfb63cf772fd.bff (Time in agent's deploy log:: 08/20/2015 08:59:24)     1              New FileSet Group

      Info         20-Aug-2015 09:59:40       Executing command: "PATCHING_ENV="Active";if [ "$PATCHING_ENV" != "Active" ];then sh aix-multibos-deploy.sh "$PATCHING_ENV" "";else for i in `fil";else for i in `file */* | grep "backup/restore format file" | cut -d ":" -f1 `;do j=`echo $i | sed -e "s/.*\///" | tr -d "\n"`;test -e "$j" || ln -s "$i" "$j";done;installp -a  -Y -g -d . -f aix_fileset.lst  ;fi" (Time in agent's deploy log:: 08/20/2015 08:59:26)               1              New FileSet Group

      Warning 20-Aug-2015 09:59:40       [stderr: 1]               29671.1/printers.rte.7.1.2.18_2fde8ad286fdc092f1bcdfb63cf772fd.bff: Permission denied (Time in agent's deploy log:: 08/20/2015 08:59:27)       1              New FileSet Group

      Warning 20-Aug-2015 09:59:40       [stderr: 1]               installp: The specified device /var/tmp/stage/8623f09751f030ef83eb8134b59f93c3/. (Time in agent's deploy log:: 08/20/2015 08:59:27)     1              New FileSet Group

      Warning 20-Aug-2015 09:59:40                       is not a valid device or file.

                                     

      Error       20-Aug-2015 09:59:40       Command returned non-zero exit code: 220 (Time in agent's deploy log:: 08/20/2015 08:59:27)    1                New FileSet Group

      Error       20-Aug-2015 09:59:40       Apply failed: id = 1 (Time in agent's deploy log:: 08/20/2015 08:59:28)  1              New FileSet Group

      Info         20-Aug-2015 09:59:40       Starting undo

      (Time in agent's deploy log:: 08/20/2015 08:59:29)                   

      Info         20-Aug-2015 09:59:40       Processing asset BLPACKAGE (Time in agent's deploy log:: 08/20/2015 08:59:29)                           

      Info         20-Aug-2015 09:59:40       Processing asset FILESETGROUP (Time in agent's deploy log:: 08/20/2015 08:59:29)      1              New FileSet Group

      Info         20-Aug-2015 09:59:40       Executing command: "PATCHING_ENV="Active";if [ "$PATCHING_ENV" != "Active" ];then echo "Undo for multibos/alt-disk is not supported."; exit 1;else /usr/sbin/installp -s -f aix_fileset.lst 2>/dev/null  | /usr/bin/awk '{ print $1 " " $3 }' > aix_reject_fileset.lst; /usr/bin/grep -v -f aix_reject_fileset.lst aix_fileset.lst > /dev/null;if [ $? -eq 0 ]; then echo "Following filesets will not be rejected" >&2; /usr/bin/grep -v -f aix_reject_fileset.lst aix_fileset.lst >&2; fi; if [ -s aix_reject_fileset.lst ]; then installp   -r -f aix_reject_fileset.lst; else echo "Nothing to reject"; fi;fi" (Time in agent's deploy log:: 08/20/2015 08:59:29)  1              New FileSet Group

      Warning 20-Aug-2015 09:59:40       [stderr: 1]               Following filesets will not be rejected (Time in agent's deploy log:: 08/20/2015 08:59:30)               1              New FileSet Group

      Warning 20-Aug-2015 09:59:40       [stderr: 1]               printers.rte 7.1.2.18 (Time in agent's deploy log:: 08/20/2015 08:59:30) 1              New FileSet Group

      Info         20-Aug-2015 09:59:40       [stdout: 1]               Nothing to reject (Time in agent's deploy log:: 08/20/2015 08:59:30)      1              New FileSet Group

      Info         20-Aug-2015 09:59:40       Received messages on STDERR for command. Treating STDERR as warning (Time in agent's deploy log:: 08/20/2015 08:59:30)                1              New FileSet Group

      Info         20-Aug-2015 09:59:40       Undo succeeded

      (Time in agent's deploy log:: 08/20/2015 08:59:30)                   

      Warning 20-Aug-2015 09:59:40       Deploy failed. Cleaning up staging area.

      (Time in agent's deploy log:: 08/20/2015 08:59:30)                   

      Warning 20-Aug-2015 09:59:40       Deploy failed. Cleaning up staging area.

      (Time in agent's deploy log:: 08/20/2015 08:59:30)                   

      Info         20-Aug-2015 09:59:40       Bldeploy done - nRet = 6 (Apply failed; auto-rollback successful) exitCode = -4001 (Deployment failed)

      (Time in agent's deploy log:: 08/20/2015 08:59:33)                   

      Error       20-Aug-2015 09:59:40       APPLY failed for server server02a. Exit code = -4001                        

      Info         20-Aug-2015 09:59:40       The job 'AIX 7.1 Remediation Job-server02a-18091 @ 2015-08-20 09-58-11-290+0100->AIX 7.1 Remediation Job-server02a-18091 @ 2015-08-20 09-58-11-290+0100' has failed on server server02a     

       

       

      The updated patch catalog and analysis jobs against this server ran fine with expected output.

      Appserver version is 8.6.00.216 running on Microsoft Windows 2012 R2. The patches were downloaded using offline downloader utility on aix server, i did not wanted the duplicate copy of the patches due to space limitation so kept payload source location path (//server01a/mksysb/Downloads/AIX/AIX71000206) same as base repo location (//server01a/mksysb/Downloads/AIX/AIX71000206). Agents mounts source for direct use at deployment and the nfs path is configured as nfs://server01a.uk.company.com/mksysb/Downloads/AIX/AIX71000206. The mount was succesful, the bldeploy log is attached for your review.


      Any pointers here would be appreciated. Thanks.       

           

        • 1. Re: Error during execution of AIX patching job.
          Jim Wilson
          08/20/15 09:28:39.182 WARN bldeploy - [1][New FileSet Group] [stderr: 1]    29671.1/printers.rte.7.1.2.18_2fde8ad286fdc092f1bcdfb63cf772fd.bff: Permission denied

           

          08/20/15 09:28:39.622 WARN bldeploy - [1][New FileSet Group] [stderr: 1]    installp: The specified device /var/tmp/stage/8623f09751f030ef83eb8134b59f93c3/.

              is not a valid device or file.

           

          08/20/15 09:28:39.692 ERROR bldeploy - [1][New FileSet Group] Command returned non-zero exit code: 220

           

          The failure has cleared up the staging area so, I would modify the deploy job to set the "preserve staging area on failure" in the Phase Options pane, run the Deploy Job again and the check settings in the staging area folders.

          1 of 1 people found this helpful
          • 2. Re: Error during execution of AIX patching job.
            Avikal Jain

            Executed the job with "preserve staging area on failure" it failed as expected so tried mounting the nfs from command prompt. The problem was with the permission on Downloads folder on server hosting the nfs share and the mount command on prompt gave the permission denied issue:

             

            nfs://server01a.uk.company.com/mksysb/Downloads/AIX/AIX71000206/


            The issue was resolved once the permission on Downloads folder were sorted out. Thanks Jim. Your help is appreciated.