5 Replies Latest reply on Feb 3, 2015 4:48 PM by Bill Robinson

    Linux catalog update job with 'update level' filter fails with error "Fatal error while updating metadata : 1"

    Chad Johnson

      First, environmentals

      BBSA Version 8.5.01.96

      OS Name = Windows Server 2008 R2

      Architecture = amd64

       

      App Server Memory Allocations

      Maximum JVM Memory (B) = 3,817,865,216

      Total JVM Memory (B) = 505,937,920

      Free JVM Memory (B) = 211,844,104

      Used JVM Memory (B) = 294,093,816

       

       

      The Problem

       

      We are trying to create red hat catalogs by update level.  I can successfully create catalogs by "Errata Type" and "Errata Advisory" but not by "Update Level".  When update level is chosen the job errors with "Fatal error while updating metadata : 1".  I have tried various values for "Update Level" without success.

       

      I have read a few other articles here regarding this problem in 8.0.x and the fix was to increase the max heap to 2048 but as you can see above, our max heap is already above that.

       

      Anyone have a fix for this???

       

      Filter screen capture

      RHN_Catalog_by_Update_Level.PNG

       

      The appserver.log contains the following:

      [08 Jan 2015 15:49:28,109] [Job-Execution-4] [INFO] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [CatalogUpdate] Started running the job 'RHEL 6.5 Patch Catalog_CUJ-2015-01-08 15-49-22-745-0500' with priority 'NORMAL' on application server 'IMCLTCLOUDPM'(2)

      [08 Jan 2015 15:49:29,311] [WorkItem-Thread-3] [INFO] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [Patch-Metadata-Updator] Executing work item RedHat Catalog Patch Metadata Update Work Item on application server: IMCLTCLOUDPM

      [08 Jan 2015 15:49:30,200] [WorkItem-Thread-3] [INFO] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [Patch-Metadata-Updator] Catalog mode is set to Online mode and Depot object processor batch size is set to 500.

      [08 Jan 2015 15:49:30,588] [WorkItem-Thread-3] [INFO] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [Patch-Metadata-Updator] Initializing

      [08 Jan 2015 15:49:32,390] [PSU-Thread-1] [INFO] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [Patch-Metadata-Updator] Executing command: which createrepo

      [08 Jan 2015 15:49:32,399] [Thread-90568] [INFO] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [Patch-Metadata-Updator] STDOUT --> /usr/bin/createrepo

      [08 Jan 2015 15:49:32,423] [PSU-Thread-1] [INFO] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [Patch-Metadata-Updator] Catalog update progress is 0% completed.

      [08 Jan 2015 15:49:32,424] [WorkItem-Thread-3] [INFO] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [Patch-Metadata-Updator] Cleaning existing workspace directory on the metadata location

      [08 Jan 2015 15:49:32,434] [WorkItem-Thread-3] [INFO] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [Patch-Metadata-Updator] Building metadata

      [08 Jan 2015 15:49:32,434] [WorkItem-Thread-3] [INFO] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [Patch-Metadata-Updator] Processing all online Channel Update Level filters

      [08 Jan 2015 15:49:33,327] [PSU-Thread-1] [INFO] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [Patch-Metadata-Updator] Patch download thread Pool shutting down.

      [08 Jan 2015 15:49:33,783] [PSU-Thread-1] [FATAL] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [Patch-Metadata-Updator] Fatal error while updating metadata

      java.lang.ArrayIndexOutOfBoundsException: 1

      at com.bmc.sa.patchfeed.redhat.util.RhnWebService.getISODownloadUrls(Unknown Source)

      at com.bmc.sa.patchfeed.redhat.RedHatMetadataManager.processOnlineUpdateLevelSKUs(Unknown Source)

      at com.bmc.sa.patchfeed.redhat.RedHatMetadataManager.processOnlineSKUs(Unknown Source)

      at com.bmc.sa.patchfeed.redhat.RedHatMetadataManager.getFeedMappings(Unknown Source)

      at com.bmc.sa.patchfeed.redhat.RedHatFeedUpdator.run(Unknown Source)

      at java.lang.Thread.run(Unknown Source)

      at com.bladelogic.om.patch.app.psu.PSUThreadFactory$PSUThread.run(PSUThreadFactory.java:81)

      [08 Jan 2015 15:49:33,783] [WorkItem-Thread-3] [ERROR] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [Patch-Metadata-Updator] Fatal error while updating metadata : 1

      [08 Jan 2015 15:49:33,797] [Job-Execution-3] [INFO] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [CatalogUpdate] Patches newly added: 0

      [08 Jan 2015 15:49:33,797] [Job-Execution-3] [INFO] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [CatalogUpdate] Patches updated: 0

      [08 Jan 2015 15:49:33,798] [Job-Execution-3] [INFO] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [CatalogUpdate] Patches obsoleted: 0

      [08 Jan 2015 15:49:33,798] [Job-Execution-3] [INFO] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [CatalogUpdate] Patches failed to be process: 0

      [08 Jan 2015 15:49:33,798] [Job-Execution-3] [INFO] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [CatalogUpdate] Patches downloaded: 0

      [08 Jan 2015 15:49:33,798] [Job-Execution-3] [INFO] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [CatalogUpdate] Patches failed to be downloaded: 0

      [08 Jan 2015 15:49:33,798] [Job-Execution-3] [INFO] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [CatalogUpdate] Patches with invalid/deprecated urls: 0

      [08 Jan 2015 15:49:33,798] [Job-Execution-3] [INFO] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [CatalogUpdate] Referrers newly added: 0

      [08 Jan 2015 15:49:33,798] [Job-Execution-3] [INFO] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [CatalogUpdate] Referrers updated: 0

      [08 Jan 2015 15:49:33,798] [Job-Execution-3] [INFO] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [CatalogUpdate] Referrers obsoleted: 0

      [08 Jan 2015 15:49:33,798] [Job-Execution-3] [INFO] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [CatalogUpdate] Referrers failed to be process: 0

      [08 Jan 2015 15:49:33,869] [Job-Execution-3] [INFO] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [CatalogUpdate] Creating the ISystem object for the host:imadccobbler and the root dir:/opt/bmcdepot/rhn_patching/rhel_6.5_x86_64

      [08 Jan 2015 15:49:33,917] [Job-Execution-3] [INFO] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [CatalogUpdate] Catalog update progress is completed.

      [08 Jan 2015 15:49:33,917] [Job-Execution-3] [ERROR] [CJohns8@NAM.ENT.DUKE-ENERGY.COM:BLAdmins:] [CatalogUpdate] The job 'RHEL 6.5 Patch Catalog_CUJ-2015-01-08 15-49-22-745-0500' has failed

      [08 Jan 2015 15:49:37,466] [Scheduled-System-Tasks-Thread-13] [INFO] [System:System:] [Memory Monitor] Total JVM (B): 505937920,Free JVM (B): 237185552,Used JVM (B): 268752368,VSize (B): 1963110400,RSS (B): 1714237440,Used File Descriptors: 3244