8 Replies Latest reply on Dec 18, 2018 2:01 AM by Mina Horiuchi

    Regarding tuning-config.xml <lock-stripe-count>

    Mina Horiuchi
      Share:|

      Hi There,

       

      I have a question regarding parameter of  tuning-config.xml".

       

      I read this doc and would like to know about this parameter <lock-stripe-count></lock-stripe-count>

      Atrium Orchestrator Tuning Parameters

       

       

      Basically, the completed job will be removed from Console page after 5 min since it completed.
      But it seems like if i changed that parameter, job information will stay even after 20 min since completed.
      so i guess the time that job will stay is relative this parameter.
      Does anyone know it?
      Kind Regards,
      Mina
        • 1. Re: Regarding tuning-config.xml <lock-stripe-count>
          Aryan Anantwar

          Hi Mina,

           

          The configuration for removing the completed jobs from Grid Console is done with minimum-completion-age-for-gc-eligibility parameter.

          IMO lock-stripe-count parameter is regarding sharing the resources between peers.

           

          Regards,

          Aryan Anantwar

          2 of 2 people found this helpful
          • 2. Re: Regarding tuning-config.xml <lock-stripe-count>
            Ranganath Samudrala

            Lock-stripe-count is a legacy configuration parameter.

             

            Before attempting to use tuning config, please contact support to make sure the problem is understood and correct parameters are used.

            1 of 1 people found this helpful
            • 3. Re: Regarding tuning-config.xml <lock-stripe-count>
              Mina Horiuchi

              Hi Aryan, Ranganath

               

              Thank you for your reply.  Yes, I was thinking same way as your answer.

              However, while i am testing about minimum-completion-age-for-gc-eligibility,  the result seems like not what you said..

              Could you see that result ?

               

              My customer have a tuning-config.xml that BMC support confirmed and said no problem and they said even if the minimum-completion-age-for-gc-eligibility value was 60000 (one minute), the completed job will stay around 30 min.

               

              Therefore using my test env, i was testing about minimum-completion-age-for-gc-eligibility. For the test, I just copy the content from the document of below .

              First I tested with Default value of 300000 (5min) for minimum-completion-age-for-gc-eligibility. But it took 10 min to be removed from console page.

               

              <config>
                  <job-manager>
                      <max-active-jobs>256</max-active-jobs>
                      <minimum-completion-age-for-gc-eligibility>300000</minimum-completion-age-for-gc-eligibility>
                      <lock-stripe-count>256</lock-stripe-count>
                  </job-manager>
                  <health>
                      <stats-dump-period>300000</stats-dump-period>
                  </health>
                  <adapter-manager>
                      <adapter-call-timeout>3600000</adapter-call-timeout>
                  </adapter-manager>
                  <grid-framework>
                      <network-tolerance-level>LOWEST</network-tolerance-level>
                      <inbound-message-processor-pool>
                          <core-size>32</core-size>
                          <maximum-size>32</maximum-size>
                          <maximum-backlog>512</maximum-backlog>
                          <reject-tasks>true</reject-tasks>
                      </inbound-message-processor-pool>
                      <logging>
                          <include-grid-framework>false</include-grid-framework>
                          <truncate-message-bytes>1024</truncate-message-bytes>
                      </logging>
                  </grid-framework>
                  <foundation>
                      <disable-modulesync>true</disable-modulesync>
                  </foundation>
              </config>

               

              I was monitoring 2 job IDs.

               

              <JOB ID : c9ebed4b5dee8e9e:-2affbf86:167a63d6ced:-7ff81-1544682518842>

              It took around 10 min (15:28:38completed. 15:37:08 be deleted.)

               

              13 12 2018 15:28:38,842 [Thread=AMP - Scheduler - MyGrid - Shared_Worker-4] DEBUG ActivityJob     [PeerName=CDP]    [Thread 197] - ActivityJob [test1206.horitest, id=c9ebed4b5dee8e9e:-2affbf86:167a63d6ced:-7ff81-1544682518842] about to be submitted to the Job Manager.

              13 12 2018 15:28:38,856 [Thread=Process Job Worker (MyGrid)] DEBUG ActivityJob     [PeerName=CDP]    [Thread 444] - Setting state from [READY] to [ASSIGNED] for job ID [c9ebed4b5dee8e9e:-2affbf86:167a63d6ced:-7ff81-1544682518842]...

              13 12 2018 15:28:38,878 [Thread=AMP - Activity Processor - Process Execution - 21] DEBUG ActivityJob     [PeerName=CDP]    [Thread 449] - Setting state from [ASSIGNED] to [COMPLETED] for job ID [c9ebed4b5dee8e9e:-2affbf86:167a63d6ced:-7ff81-1544682518842/:horitest:aaa:start:call-process[1]/:horitest:Send Email:start:call-process[1]]...

              13 12 2018 15:37:08,795 [Thread=AMP - Activity Maintenance Worker  (MyGrid) - 1] DEBUG DefaultJobStore [PeerName=CDP]    Got request to remove jobs from the store for job IDs : [[JobID representation=c9ebed4b5dee8e9e:-2affbf86:167a63d6ced:-7ff81-1544682518842, timestamp=Thu Dec 13 15:28:38 JST 2018]]

              13 12 2018 15:37:08,796 [Thread=AMP - Activity Maintenance Worker  (MyGrid) - 1] DEBUG DefaultSharedJobManager [PeerName=CDP]    Unassigning jobs from shared resource "job-manager-jobs-192" [c9ebed4b5dee8e9e:-2affbf86:167a63d6ced:-7ff81-1544682518842]

              13 12 2018 15:37:08,796 [Thread=AMP - Activity Maintenance Worker  (MyGrid) - 1] DEBUG DefaultSharedJobManager [PeerName=CDP]    Releasing resources for job IDs : [[JobID representation=c9ebed4b5dee8e9e:-2affbf86:167a63d6ced:-7ff81-1544682518842, timestamp=Thu Dec 13 15:28:38 JST 2018]]

               

               

              <JOB ID : c9ebed4b5dee8e9e:-2affbf86:167a63d6ced:-7ff81-1544682578877>

              Other job id also took 10 min.

               

              13 12 2018 15:29:38,877 [Thread=AMP - Scheduler - MyGrid - Shared_Worker-5] DEBUG ActivityJob     [PeerName=CDP]    [Thread 198] - ActivityJob [test1206.horitest, id=c9ebed4b5dee8e9e:-2affbf86:167a63d6ced:-7ff81-1544682578877] about to be submitted to the Job Manager.

              13 12 2018 15:29:38,877 [Thread=AMP - Scheduler - MyGrid - Shared_Worker-5] DEBUG DefaultLocalJobManager [PeerName=CDP]    [Thread 198] - Job [ActivityJob (id=c9ebed4b5dee8e9e:-2affbf86:167a63d6ced:-7ff81-1544682578877, name=test1206, state=READY, isPending=false, isPendingReassignment=false, isProcessing=false, assignedPeerName=null)] was submitted for processing.

              13 12 2018 15:29:38,882 [Thread=Process Job Worker (MyGrid)] DEBUG ActivityJob     [PeerName=CDP]    [Thread 481] - Setting state from [READY] to [ASSIGNED] for job ID [c9ebed4b5dee8e9e:-2affbf86:167a63d6ced:-7ff81-1544682578877]...

              13 12 2018 15:29:38,925 [Thread=AMP - Activity Processor - Process Execution - 27] DEBUG ActivityJob     [PeerName=CDP]    [Thread 488] - Setting state from [ASSIGNED] to [COMPLETED] for job ID [c9ebed4b5dee8e9e:-2affbf86:167a63d6ced:-7ff81-1544682578877/:horitest:aaa:start:call-process[1]/:horitest:Send Email:start:call-process[1]]...

              13 12 2018 15:38:52,926 [Thread=AMP - Activity Maintenance Worker  (MyGrid) - 1] DEBUG DefaultJobStore [PeerName=CDP]    Got request to remove jobs from the store for job IDs : [[JobID representation=c9ebed4b5dee8e9e:-2affbf86:167a63d6ced:-7ff81-1544682578877, timestamp=Thu Dec 13 15:29:38 JST 2018]]

              13 12 2018 15:38:52,927 [Thread=AMP - Activity Maintenance Worker  (MyGrid) - 1] DEBUG DefaultSharedJobManager [PeerName=CDP]    Unassigning jobs from shared resource "job-manager-jobs-40" [c9ebed4b5dee8e9e:-2affbf86:167a63d6ced:-7ff81-1544682578877]

              13 12 2018 15:38:52,927 [Thread=AMP - Activity Maintenance Worker  (MyGrid) - 1] DEBUG DefaultSharedJobManager [PeerName=CDP]    Releasing resources for job IDs : [[JobID representation=c9ebed4b5dee8e9e:-2affbf86:167a63d6ced:-7ff81-1544682578877, timestamp=Thu Dec 13 15:29:38 JST 2018]]

               

              ============================================

               

               

              Anyway, i changed minimum-completion-age-for-gc-eligibility value to 60000 (one minute).

              It removed after 3~5 min since completed.

               

              <JOB ID : 583abf5d933cf825:-4443164c:167a661f4d1:-7ff81-1544684798986>

              Took 3 min.

               

              13 12 2018 16:06:39,094 [Thread=AMP - Activity Processor - Process Execution - 9] DEBUG ActivityJob     [PeerName=CDP]    [Thread 379] - Setting state from [ASSIGNED] to [COMPLETED] for job ID [583abf5d933cf825:-4443164c:167a661f4d1:-7ff81-1544684798986/:horitest:aaa:start:call-process[1]/:horitest:Send Email:start:call-process[1]]...

              13 12 2018 16:09:46,676 [Thread=AMP - Activity Maintenance Worker  (MyGrid) - 1] DEBUG DefaultJobStore [PeerName=CDP]    Got request to remove jobs from the store for job IDs : [[JobID representation=583abf5d933cf825:-4443164c:167a661f4d1:-7ff81-1544684798986, timestamp=Thu Dec 13 16:06:38 JST 2018]]

              13 12 2018 16:09:46,676 [Thread=AMP - Activity Maintenance Worker  (MyGrid) - 1] DEBUG DefaultSharedJobManager [PeerName=CDP]    Unassigning jobs from shared resource "job-manager-jobs-13" [583abf5d933cf825:-4443164c:167a661f4d1:-7ff81-1544684798986]

              13 12 2018 16:09:46,676 [Thread=AMP - Activity Maintenance Worker  (MyGrid) - 1] DEBUG DefaultSharedJobManager [PeerName=CDP]   Releasing resources for job IDs : [[JobID representation=583abf5d933cf825:-4443164c:167a661f4d1:-7ff81-1544684798986, timestamp=Thu Dec 13 16:06:38 JST 2018]]

               

              <JOB ID : 583abf5d933cf825:-4443164c:167a661f4d1:-7ff81-1544684858843>

              Took 5 min.

               

              13 12 2018 16:07:38,868 [Thread=AMP - Activity Processor - Process Execution - 15] DEBUG ActivityJob     [PeerName=CDP]    [Thread 422] - Setting state from [ASSIGNED] to [COMPLETED] for job ID [583abf5d933cf825:-4443164c:167a661f4d1:-7ff81-1544684858843/:horitest:aaa:start:call-process[1]/:horitest:Send Email:start:call-process[1]]...

              13 12 2018 16:12:31,896 [Thread=AMP - Activity Maintenance Worker  (MyGrid) - 1] DEBUG DefaultJobStore [PeerName=CDP]    Got request to remove jobs from the store for job IDs : [[JobID representation=583abf5d933cf825:-4443164c:167a661f4d1:-7ff81-1544684858843, timestamp=Thu Dec 13 16:07:38 JST 2018]]

              13 12 2018 16:12:31,896 [Thread=AMP - Activity Maintenance Worker  (MyGrid) - 1] DEBUG DefaultSharedJobManager [PeerName=CDP]    Unassigning jobs from shared resource "job-manager-jobs-178" [583abf5d933cf825:-4443164c:167a661f4d1:-7ff81-1544684858843]

              13 12 2018 16:12:31,897 [Thread=AMP - Activity Maintenance Worker  (MyGrid) - 1] DEBUG DefaultSharedJobManager [PeerName=CDP]    Releasing resources for job IDs : [[JobID representation=583abf5d933cf825:-4443164c:167a661f4d1:-7ff81-1544684858843, timestamp=Thu Dec 13 16:07:38 JST 2018]]

               

              <JOB ID : 583abf5d933cf825:-4443164c:167a661f4d1:-7ff81-1544684978842>

              Took 5 min.

               

              13 12 2018 16:09:38,894 [Thread=AMP - Activity Processor - Process Execution - 27] DEBUG ActivityJob     [PeerName=CDP]    [Thread 506] - Setting state from [ASSIGNED] to [COMPLETED] for job ID [583abf5d933cf825:-4443164c:167a661f4d1:-7ff81-1544684978842/:horitest:aaa:start:call-process[1]/:horitest:Send Email:start:call-process[1]]...

              13 12 2018 16:14:08,017 [Thread=AMP - Activity Maintenance Worker  (MyGrid) - 1] DEBUG DefaultJobStore [PeerName=CDP]    Got request to remove jobs from the store for job IDs : [[JobID representation=583abf5d933cf825:-4443164c:167a661f4d1:-7ff81-1544684978842, timestamp=Thu Dec 13 16:09:38 JST 2018]]

              13 12 2018 16:14:08,017 [Thread=AMP - Activity Maintenance Worker  (MyGrid) - 1] DEBUG DefaultSharedJobManager [PeerName=CDP]    Unassigning jobs from shared resource "job-manager-jobs-18" [583abf5d933cf825:-4443164c:167a661f4d1:-7ff81-1544684978842]

              13 12 2018 16:14:08,017 [Thread=AMP - Activity Maintenance Worker  (MyGrid) - 1] DEBUG DefaultSharedJobManager [PeerName=CDP]    Releasing resources for job IDs : [[JobID representation=583abf5d933cf825:-4443164c:167a661f4d1:-7ff81-1544684978842, timestamp=Thu Dec 13 16:09:38 JST 2018]]

               

               

              I think it is wired ... or am i misunderstanding about minimum-completion-age-for-gc-eligibility?

               

              Best Regards,

              Mina

              • 4. Re: Regarding tuning-config.xml <lock-stripe-count>
                Ranganath Samudrala

                Have you tried to trying to getting job status - outside looking at log files...may be using REST API or ORCA web service call or using grid manager -> status->processes tab? Try getting the status after 5 minutes or 10 minutes.

                • 5. Re: Regarding tuning-config.xml <lock-stripe-count>
                  Gordon McKeown

                  Set up a simple workflow to run on a 1-minute schedule and publish/activate on the grid. Then check the process list in Grid Manager (Status -> [gridname] -> Processes).

                   

                  That should give a fair indication of how quickly jobs are getting removed.

                  • 6. Re: Regarding tuning-config.xml <lock-stripe-count>
                    Mina Horiuchi

                    Hi Ranganath Gordon,

                     

                    Thank you for your reply.

                     

                    Do you guys mean about Job remove from "Status -> [gridname] -> Processes" ?

                    I want to remove from https:server-name:38080/baocdp/console. [My grid] -> [Jobs]

                     

                    I am wondering i misunderstand about tuning-config?..  tuning config xml is affect to [Process] tab on grid and it is not affect on the Grid console page of here?

                     

                    • 7. Re: Regarding tuning-config.xml <lock-stripe-count>
                      Ranganath Samudrala

                      I would not look at console - that is more like a debugging tool - like looking at logs. Those jobs have expired and if you used ORCA or REST to get job status, you will get an empty response.

                      1 of 1 people found this helpful
                      • 8. Re: Regarding tuning-config.xml <lock-stripe-count>
                        Mina Horiuchi

                        Hi Ranganath,

                         

                        Thank you for your reply. I see...

                        Could you teach me where exactly will be affected by the tuning-congif.xml ..? It is "Status -> [gridname] -> Processes" ?

                         

                        Also one more things if you knew it, please tell me.

                        Regarding <lock-stripe-count>,I read it is setting for shared among peers so i am wondering Is this setting nothing if the environment have only one Peer?

                         

                        Best Regards,

                        Mina