9 Replies Latest reply on May 14, 2015 7:16 PM by Bill Robinson

    Delete cleanupDatabase error: Command execution failed.  Failed to delete objects for class:SJobRunOfPatchRMDJob

    Yanick Girouard

      Running BSA 8.5.00.469 on Windows with Oracle as our db engine, and trying to run the database cleanup jobs completely in a while. Everything worked fine except for ths cleanupDatabase job, which gave this error:

       

      Command execution failed.  Failed to delete objects for class:SJobRunOfPatchRMDJob

       

      The blcli.log on the app server shows the following error:

       

      ORA-02292: integrity constraint (DBABSA.FK1_JOBRUN_CATALOG) violated - child record found

       

      Full error stack below:

       

      08 May 2015 13:06:13,849 INFO [MESSAGE] Command execution failed.  [/MESSAGE]
      com.bladelogic.om.infra.mfw.util.BlException: Failed to delete objects for class:SJobRunOfPatchRMDJob
        at com.bladelogic.om.infra.app.service.cleanup.CleanupOperationImpl.hardDeleteObjectsByClass(CleanupOperationImpl.java:618)
        at com.bladelogic.om.infra.app.service.cleanup.CleanupOperationImpl.hardDeleteAllObjectsByClass(CleanupOperationImpl.java:494)
        at com.bladelogic.om.infra.app.service.cleanup.CleanupOperationImpl.hardDeleteAllTopLevelObjects(CleanupOperationImpl.java:160)
        at com.bladelogic.om.infra.app.service.cleanup.CleanupOperationImpl.hardDeleteAllObjects(CleanupOperationImpl.java:96)
        at com.bladelogic.om.infra.app.service.cleanup.BaseCleanupServiceImpl.internal_hardDeleteAllObjects(BaseCleanupServiceImpl.java:1616)
        at com.bladelogic.om.infra.app.service.cleanup.BaseCleanupServiceImpl.hardDeleteAllObjects(BaseCleanupServiceImpl.java:1558)
        at com.bladelogic.om.infra.app.service.cleanup.BaseCleanupServiceImpl.cleanupDatabase(BaseCleanupServiceImpl.java:1489)
        at com.bladelogic.om.infra.app.api.factory.DeleteServiceImpl.cleanupDatabase(DeleteServiceImpl.java:515)
        at com.bladelogic.om.infra.app.api.factory.DeleteServiceImpl.cleanupDatabase(DeleteServiceImpl.java:507)
        at com.bladelogic.om.infra.app.api.DeleteServiceRequestHandlerImpl.cleanupDatabase_28(DeleteServiceRequestHandlerImpl.java:1329)
        at com.bladelogic.om.infra.app.api.DeleteServiceRequestHandlerImpl.execute(DeleteServiceRequestHandlerImpl.java:289)
        at com.bladelogic.om.infra.app.api.manage.APIMethodInvocationProvider.executeRequest(APIMethodInvocationProvider.java:54)
        at com.bladelogic.om.infra.app.api.manage.APIMethodInvocationProvider.invoke(APIMethodInvocationProvider.java:39)
        at com.bladelogic.om.infra.app.service.routing.RoutingServiceImpl.invokeMethodLocally(RoutingServiceImpl.java:267)
        at com.bladelogic.om.infra.app.service.routing.RoutingServiceImpl.invoke(RoutingServiceImpl.java:210)
        at com.bladelogic.om.infra.app.api.manage.APIRequestManager.executeRequest(APIRequestManager.java:30)
        at com.bladelogic.om.infra.message.app.frame.APIMessageFrame.service(APIMessageFrame.java:113)
        at com.bladelogic.om.infra.mfw.net.ClientWorkerThread.processRequest(ClientWorkerThread.java:385)
        at com.bladelogic.om.infra.mfw.net.ClientWorkerThread.processClientRequest(ClientWorkerThread.java:282)
        at com.bladelogic.om.infra.mfw.net.ClientWorkerThread.handleClientRequest(ClientWorkerThread.java:182)
        at com.bladelogic.om.infra.mfw.net.ClientWorkerThread.execute(ClientWorkerThread.java:101)
        at com.bladelogic.om.infra.mfw.net.ClientWorkerThread.execute(ClientWorkerThread.java:27)
        at com.bladelogic.om.infra.app.service.thread.BlBlockingThread.run(BlBlockingThread.java:95)
      Caused by: com.bladelogic.om.infra.mfw.util.BlException: Descendents of SJobRunOfPatchRMDJob are: [SDisplayString, SDisplayStringSet, SNTIAuditTrail, SJobResultDepotObject, SNTIBootOrder, SDeployJobRunEvent, SNTILanNic, SNTIPolicy, SNTIVMNicConfig, SJobResultBLGroup, SNTISanNic, SObjectOverflowDetail, SJobResultDevice, SJobRunEvent, SObjectOverflow, SPatchRmdResult, SJobResultComponent, SPatchRmdDnlJobRunAssoc, SJobRunEtlCdc, SPatchRmdJobResult, SNimbusTemplateInstance, SJobRunOverriddenPsi, SJobRunSchedule, SACEMaskValue, SListBlValueElement, SPropertyReferenceBlValue, SPropertyReferenceProperty, SPropertyReference, SAceMaskBlValue, SACEValue, SPropertySetInstanceOverriddenValueMap, SPropertySetInstanceAuditTrail, SPropertySetInstance, SListBlValue, SPrimitiveBlValue, SEnumeratedBlValue, SRangeBlValue, SAceBlValue, SBlValue]
        at com.bladelogic.om.infra.app.service.cleanup.DefaultObjectDeleter.hardDeleteObjectAndChildren(DefaultObjectDeleter.java:822)
        at com.bladelogic.om.infra.app.service.cleanup.DefaultObjectDeleter.deleteCompositeObjects(DefaultObjectDeleter.java:122)
        at com.bladelogic.om.infra.app.service.cleanup.CleanupOperationImpl$2.doDBOperation(CleanupOperationImpl.java:591)
        at com.bladelogic.om.infra.app.db.TransactionalOperation.manageTransaction(TransactionalOperation.java:182)
        at com.bladelogic.om.infra.app.db.TransactionalOperation.execute(TransactionalOperation.java:136)
        at com.bladelogic.om.infra.app.service.cleanup.CleanupOperationImpl.hardDeleteObjectsByClass(CleanupOperationImpl.java:603)
        ... 22 more
      Caused by: com.bladelogic.om.infra.mfw.util.BlException: Failed to update class for deletion :SJobRunOfPatchRMDJob query id STREAMABLE_DELETION_JOB_RUN_OF_PATCH_RMDJOB_DELETED_OBJECTS_MARKED_RANGE_FOR_DELETION
        at com.bladelogic.om.infra.app.service.cleanup.DefaultObjectDeleter.hardDeleteObjectsForClass(DefaultObjectDeleter.java:1155)
        at com.bladelogic.om.infra.app.service.cleanup.DefaultObjectDeleter.hardDeleteObjectAndChildren(DefaultObjectDeleter.java:786)
        ... 27 more
      Caused by: java.sql.SQLIntegrityConstraintViolationException: ORA-02292: integrity constraint (DBABSA.FK1_JOBRUN_CATALOG) violated - child record found
      
      
        at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:440)
        at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:396)
        at oracle.jdbc.driver.T4C8Oall.processError(T4C8Oall.java:837)
        at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:445)
        at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:191)
        at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:523)
        at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:207)
        at oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:1010)
        at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1315)
        at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3576)
        at oracle.jdbc.driver.OraclePreparedStatement.executeUpdate(OraclePreparedStatement.java:3657)
        at oracle.jdbc.driver.OraclePreparedStatementWrapper.executeUpdate(OraclePreparedStatementWrapper.java:1350)
        at com.bladelogic.om.infra.shared.db.BlPreparedStatement.executeUpdate(BlPreparedStatement.java:63)
        at org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:105)
        at org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:105)
        at com.bladelogic.om.infra.app.service.db.DefaultDatabaseServiceImpl.executeUpdate(DefaultDatabaseServiceImpl.java:1579)
        at com.bladelogic.om.infra.app.service.db.DefaultDatabaseServiceImpl.executeUpdate(DefaultDatabaseServiceImpl.java:1438)
        at com.bladelogic.om.infra.app.service.db.DefaultDatabaseServiceImpl.executeUpdate(DefaultDatabaseServiceImpl.java:1429)
        at com.bladelogic.om.infra.app.service.cleanup.DefaultObjectDeleter.hardDeleteObjectsForClass(DefaultObjectDeleter.java:1142)
        ... 28 more
      08 May 2015 13:06:13,880 INFO [MESSAGE] Cancelling operation... [/MESSAGE]
      
      

       

      Any idea how to fix this? I figure there's a query I can run to remediate it?

        • 2. Re: Delete cleanupDatabase error: Command execution failed.  Failed to delete objects for class:SJobRunOfPatchRMDJob
          Yanick Girouard

          Thanks, good to know. Is there any way to remediate it in 8.5.00.469, or do we absolutely have to upgrade to fix it?

          • 3. Re: Delete cleanupDatabase error: Command execution failed.  Failed to delete objects for class:SJobRunOfPatchRMDJob
            Bill Robinson

            Upgrade is the only way.  there are other issues in 8.5 and 8.5.01 so i would certainly suggest upgrading to patch5.

            • 4. Re: Delete cleanupDatabase error: Command execution failed.  Failed to delete objects for class:SJobRunOfPatchRMDJob
              Yanick Girouard

              I'll pass it along to my team then. Thanks. Are there any issues or upgrade considrerations in 8.5 SP1 Patch5 worth mentioning or paying attention to (mostly regarding Windows patching)?

              • 5. Re: Delete cleanupDatabase error: Command execution failed.  Failed to delete objects for class:SJobRunOfPatchRMDJob
                Bill Robinson

                i don’t know of any w/ windows patching.  there are a couple issues w/ patching specifically though that are fixed by patch5 (i think fixed in patch3 or 4 actually) where patching jobs were hanging and never completing.

                • 6. Re: Delete cleanupDatabase error: Command execution failed.  Failed to delete objects for class:SJobRunOfPatchRMDJob
                  Yanick Girouard

                  We have just upgraded our DEV to 8.5.01.304 and we are still getting the exact same error when running the cleanupDadatabse command.

                   

                  13 May 2015 13:35:52,908 INFO [MESSAGE] Command execution failed.  [/MESSAGE]
                  com.bladelogic.om.infra.mfw.util.BlException: Failed to delete objects for class:SJobRunOfPatchRMDJob
                    at com.bladelogic.om.infra.app.service.cleanup.CleanupOperationImpl.hardDeleteObjectsByClass(CleanupOperationImpl.java:618)
                    at com.bladelogic.om.infra.app.service.cleanup.CleanupOperationImpl.hardDeleteAllObjectsByClass(CleanupOperationImpl.java:494)
                    at com.bladelogic.om.infra.app.service.cleanup.CleanupOperationImpl.hardDeleteAllTopLevelObjects(CleanupOperationImpl.java:160)
                    at com.bladelogic.om.infra.app.service.cleanup.CleanupOperationImpl.hardDeleteAllObjects(CleanupOperationImpl.java:96)
                    at com.bladelogic.om.infra.app.service.cleanup.BaseCleanupServiceImpl.internal_hardDeleteAllObjects(BaseCleanupServiceImpl.java:1616)
                    at com.bladelogic.om.infra.app.service.cleanup.BaseCleanupServiceImpl.hardDeleteAllObjects(BaseCleanupServiceImpl.java:1558)
                    at com.bladelogic.om.infra.app.service.cleanup.BaseCleanupServiceImpl.cleanupDatabase(BaseCleanupServiceImpl.java:1489)
                    at com.bladelogic.om.infra.app.api.factory.DeleteServiceImpl.cleanupDatabase(DeleteServiceImpl.java:515)
                    at com.bladelogic.om.infra.app.api.factory.DeleteServiceImpl.cleanupDatabase(DeleteServiceImpl.java:507)
                    at com.bladelogic.om.infra.app.api.DeleteServiceRequestHandlerImpl.cleanupDatabase_28(DeleteServiceRequestHandlerImpl.java:1329)
                    at com.bladelogic.om.infra.app.api.DeleteServiceRequestHandlerImpl.execute(DeleteServiceRequestHandlerImpl.java:289)
                    at com.bladelogic.om.infra.app.api.manage.APIMethodInvocationProvider.executeRequest(APIMethodInvocationProvider.java:54)
                    at com.bladelogic.om.infra.app.api.manage.APIMethodInvocationProvider.invoke(APIMethodInvocationProvider.java:39)
                    at com.bladelogic.om.infra.app.service.routing.RoutingServiceImpl.invokeMethodLocally(RoutingServiceImpl.java:267)
                    at com.bladelogic.om.infra.app.service.routing.RoutingServiceImpl.invoke(RoutingServiceImpl.java:210)
                    at com.bladelogic.om.infra.app.api.manage.APIRequestManager.executeRequest(APIRequestManager.java:30)
                    at com.bladelogic.om.infra.message.app.frame.APIMessageFrame.service(APIMessageFrame.java:113)
                    at com.bladelogic.om.infra.mfw.net.ClientWorkerThread.processRequest(ClientWorkerThread.java:385)
                    at com.bladelogic.om.infra.mfw.net.ClientWorkerThread.processClientRequest(ClientWorkerThread.java:282)
                    at com.bladelogic.om.infra.mfw.net.ClientWorkerThread.handleClientRequest(ClientWorkerThread.java:182)
                    at com.bladelogic.om.infra.mfw.net.ClientWorkerThread.execute(ClientWorkerThread.java:101)
                    at com.bladelogic.om.infra.mfw.net.ClientWorkerThread.execute(ClientWorkerThread.java:27)
                    at com.bladelogic.om.infra.app.service.thread.BlBlockingThread.run(BlBlockingThread.java:95)
                  Caused by: com.bladelogic.om.infra.mfw.util.BlException: Descendents of SJobRunOfPatchRMDJob are: [SDisplayString, SDisplayStringSet, SNTIBootOrder, SNTISanNic, SNTILanNic, SJobResultDevice, SPatchRmdResult, SNTIPolicy, SNTIAuditTrail, SJobResultBLGroup, SObjectOverflowDetail, SDeployJobRunEvent, SJobRunEvent, SObjectOverflow, SJobResultDepotObject, SNTIVMNicConfig, SJobResultComponent, SNimbusTemplateInstance, SJobRunSchedule, SJobRunEtlCdc, SPatchRmdJobResult, SJobRunOverriddenPsi, SPatchRmdDnlJobRunAssoc, SACEMaskValue, SListBlValueElement, SPropertyReferenceBlValue, SPropertyReferenceProperty, SPropertyReference, SAceMaskBlValue, SACEValue, SPropertySetInstanceOverriddenValueMap, SPropertySetInstanceAuditTrail, SPropertySetInstance, SListBlValue, SPrimitiveBlValue, SEnumeratedBlValue, SRangeBlValue, SAceBlValue, SBlValue]
                    at com.bladelogic.om.infra.app.service.cleanup.DefaultObjectDeleter.hardDeleteObjectAndChildren(DefaultObjectDeleter.java:830)
                    at com.bladelogic.om.infra.app.service.cleanup.DefaultObjectDeleter.deleteCompositeObjects(DefaultObjectDeleter.java:122)
                    at com.bladelogic.om.infra.app.service.cleanup.CleanupOperationImpl$2.doDBOperation(CleanupOperationImpl.java:591)
                    at com.bladelogic.om.infra.app.db.TransactionalOperation.manageTransaction(TransactionalOperation.java:182)
                    at com.bladelogic.om.infra.app.db.TransactionalOperation.execute(TransactionalOperation.java:136)
                    at com.bladelogic.om.infra.app.service.cleanup.CleanupOperationImpl.hardDeleteObjectsByClass(CleanupOperationImpl.java:603)
                    ... 22 more
                  Caused by: com.bladelogic.om.infra.mfw.util.BlException: Failed to update class for deletion :SJobRunOfPatchRMDJob query id STREAMABLE_DELETION_JOB_RUN_OF_PATCH_RMDJOB_DELETED_OBJECTS_MARKED_RANGE_FOR_DELETION
                    at com.bladelogic.om.infra.app.service.cleanup.DefaultObjectDeleter.hardDeleteObjectsForClass(DefaultObjectDeleter.java:1163)
                    at com.bladelogic.om.infra.app.service.cleanup.DefaultObjectDeleter.hardDeleteObjectAndChildren(DefaultObjectDeleter.java:794)
                    ... 27 more
                  Caused by: java.sql.SQLIntegrityConstraintViolationException: ORA-02292: integrity constraint (DBABSA.FK1_JOBRUN_CATALOG) violated - child record found
                  
                  
                    at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:440)
                    at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:396)
                    at oracle.jdbc.driver.T4C8Oall.processError(T4C8Oall.java:837)
                    at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:445)
                    at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:191)
                    at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:523)
                    at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:207)
                    at oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:1010)
                    at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1315)
                    at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3576)
                    at oracle.jdbc.driver.OraclePreparedStatement.executeUpdate(OraclePreparedStatement.java:3657)
                    at oracle.jdbc.driver.OraclePreparedStatementWrapper.executeUpdate(OraclePreparedStatementWrapper.java:1350)
                    at com.bladelogic.om.infra.shared.db.BlPreparedStatement.executeUpdate(BlPreparedStatement.java:63)
                    at org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:105)
                    at org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:105)
                    at com.bladelogic.om.infra.app.service.db.DefaultDatabaseServiceImpl.executeUpdate(DefaultDatabaseServiceImpl.java:1579)
                    at com.bladelogic.om.infra.app.service.db.DefaultDatabaseServiceImpl.executeUpdate(DefaultDatabaseServiceImpl.java:1438)
                    at com.bladelogic.om.infra.app.service.db.DefaultDatabaseServiceImpl.executeUpdate(DefaultDatabaseServiceImpl.java:1429)
                    at com.bladelogic.om.infra.app.service.cleanup.DefaultObjectDeleter.hardDeleteObjectsForClass(DefaultObjectDeleter.java:1150)
                    ... 28 more
                  
                  • 8. Re: Delete cleanupDatabase error: Command execution failed.  Failed to delete objects for class:SJobRunOfPatchRMDJob
                    Yanick Girouard

                    Support answered me and provided a new version of the alter85xConstraints.sql for Oracle (see attached), which seems to be newer than the one included with the 85-SP1-P5-HF1-SQL_Update_Scripts.zip file available on the EPD.

                     

                    The zip on the EPD should be updated with this new version if it was modified since its initial release, as it doesn't seem to fix the FK1_JOBRUN_CATALOG foreign key at all, but the latest version does.

                    • 9. Re: Delete cleanupDatabase error: Command execution failed.  Failed to delete objects for class:SJobRunOfPatchRMDJob
                      Bill Robinson

                      Ok, i was thinking of a different defect (QM001869496) that looked similar.