The Pulse: New Day Enhancements, Best Practices and Troubleshooting webinar Q&A"

Version 1
    Share This:

    Here are the answers to the Q&A Session for the “Connect with Control-M webinar: New Day Enhancements, Best Practices and Troubleshooting”. You can watch this webinar here:
    https://bmcwebinars.webex.com/bmcwebinars/lsr.php?RCID=2e93f7e3b9604888b81d21ce4ddf990e

    ________________________________________________________________
    Q:  What is the benefit of the parallel automatic order and downloading again ?

    A: The parallel allows the SYSTEM user daily to run multi-threaded. If you do not use the pre-order or if the pre-order doesn’t complete then the system will use the regular SYSTEM user daily. The parallel will speed up this process.
    The download threads will be used to multi-thread the database calls for the download process decreasing the time of the downloads. Here is a summary of the parameters:

    NEWDAY_MODE – causes the pre-order New Day process to happen
    SYSTEM_DAILY_THREADS – causes the SYSTEM user daily to be multi-threaded
    PARALLEL_LASTNO – needed to allow the SYSTEM_DAILY_THREADS
    DOWNLOAD_THREADS – causes the download process to be multi-threaded  
    ________________________________________________________________
    Q:  What is the benefit of the DOWNLOAD_THREADS?  Does this reduce the amount of time the Download takes to complete?

    A: DOWNLOAD_THREADS allows multiple threads to the database so that the download process is faster.
    ________________________________________________________________
    Q:  Is the New Day parameter in Control-m/em only in v.8 or in v.7.3 too?

    A: The New Day parameters are only in the Control-M/Server and this is for all versions.  
    ________________________________________________________________
    Q: Why does it say Formatting AJF when we are calling it the AJD?
    A: This message is from V7 and will be updated.
    ________________________________________________________________
    Q:  Can the "Keep Active" +1 related to the purge 'old' jobs be disabled or changed?

    A: No, this can’t be disabled or changed. Please open a support issue if you have a business case for changing this.
    ________________________________________________________________
    Q:  Could you mention that the MF(IOA) datacenters don't add 1 for ENDED NOTOK?

    A: On the mainframe, the jobs that end NOTOK don’t automatically stay in the AJD for at least one day.
    ________________________________________________________________
    Q:  If a job is Ended Ok and it's MAXWAIT value is 2/1. It will purge or not

    A: If a job ends OK, then it will get purged at New Day regardless of the MAXWAIT (Keep) parameter.
    ________________________________________________________________
    Q:  If we do not the pre-ordering, how can that be disabled?

    A: You can disable the pre-ordering by setting the NEWDAY_MODE parameter to 0.
    ________________________________________________________________

    Q:  Can Pre-ordering be used with combination of ctmorder? Meaning, i would pre-order jobs and trigger 'copying' them from the temporary table into AJF by ctmorder?

    A: No. The New Day pre-ordering doesn’t run any jobs, so you can’t add more jobs to the pre-ordering with a ctmorder command.
    ________________________________________________________________

    Q:  if you troubleshoot preorder jobs, are they run by CD also?

    A: The CD process was integrated into the CE process. However, the CD process still generates messages to ctmlog with the “CD” prefix.
    ________________________________________________________________

    Q:  Any new processing from the Control-M processes - i.e. in the past, it was just the CD; however, I think the CD has been renamed but the ctmlog for CD works...

    A: In V7, we introduced the CE process and the CD process was integrated into the CE process. However, it still generates messages to the ctmlog with the “CD” prefix.
    ________________________________________________________________

    Q:  ..and the same question, but copying the pre-ordered jobs from temporary table into AJF by ctmudly?

    A: No, the ctmudly will not affect any jobs processed by the New Day pre-ordering.
    ________________________________________________________________

    Q:  We have the config parameter CYCLIC_MAXWAIT set to not_keep - will this work the same in V8?

    A: Yes.
    ________________________________________________________________
    Q:  also what about the affects of using timezones on NDP and automatic ordering .

    A: Yes, jobs with timezone settings will be handling differently during New Day. We have a Connect with ControlM webinar on Timezone.
    ________________________________________________________________
    Q:  For jobs that has an order Method of Automatic, will those jobs order in even if a user daily is not provided (As long as they meet the scheduling criteria)?

    A: Yes – Folders that have the “Automatic” order method are in the SYSTEM User Daily.
    ________________________________________________________________
    Q:  We run 5 user dailies and all but one of them run 1 minute.  The long running one runs approx. 9-10 minutes and only loads about 1000 jobs.  What could cause a user daily to run long?

    A:  The amount of time for a user daily is affected by the # of calendars and scheduling criteria that has to be evaluated. You can contact support if you think there is a problem. Additionally, moving this to the Pre-Ordering will help to reduce the impact of this.
    ________________________________________________________________
    Q:  What is the best method in v8 to order jobs (out of the 3 options mentioned in the polling question)

    A: There will be factors specific to your environment so a general answer may not meet the needs of all environments, but generally, using the pre-order method and the SYSTEM (automatic) ordering would be the fastest.
    ________________________________________________________________
    Q:  Can you talk a little about the "mini new day"

    A: Mini New Day is used for jobs with Timezones. There is another Connect With ControlM webinar titled “Using Time Zones” that addresses this topic. You can view that webinar here: https://bmcwebinars.webex.com/bmcwebinars/lsr.php?RCID=826d1214b43607d84c3edef9194a1321
    ________________________________________________________________
    Q:  Pre-ordering takes approximately 30% more database space?  Do I recall this correctly?

    A: Yes – this is just an estimate but since the new jobs are ordered into a temporary table in the background this is where the additional database space is needed.
    ________________________________________________________________
    Q:  Is it possible to simulate a New Day before the actual New Day runs ?

    A: You can use the Forecast product to simulate the jobs that will be ordered at New Day. 
    ________________________________________________________________

    Q:  What were the 2 commands to multi-thread the user daily's?

    A: The user daily command is not multi-threaded, only the SYSTEM user daily.
    ________________________________________________________________
    Q:  How to enable pre-ordering on Folders / Jobs?

    A: The New Day pre-ordering feature is enabled with the “NEWDAY_MODE” parameter. 0 is disabled and 1 is enabled.
      
    ________________________________________________________________
    Q:  what is the practical use of using pre-order feature, before New Day process kicks off?

    A: The practical use is that the processing time to determine which jobs need to be ordered in happens in the background before New Day. The pre-ordering will build a temporary database table with the next days jobs so that at New Day, all of the processing is finished and it just has to load the jobs from the temporary table.

    ________________________________________________________________
    Q:  Does removing pre requisite conditions as jobs finish, improve the new day process

    A: A little bit. There is a stage in the New Day process that purges old conditions so if you are purging these during new day then it would save the amount of time to do this. However, the purging of conditions can also be accomplished using the ctmruninf utility.
    ________________________________________________________________
    Q:  We ensure all Conditions are cleaned-up, even STATs.  Do you know of any that stop the calculation of the 'year old' condition?  We do find this troublesome at time change ...

    A: Yes – there is a parameter that will cause New Day not to purge the conditions that are exactly 1 year old. This parameter is “Ignore New Day Conditions”. It is not recommended to use this parameter.
    ________________________________________________________________
    Q:  On the midtier, when you were talking about the purging of old jobs, has the ENDED NOTOK always rolled off according to the Max wait +1 default?

    A: Yes – for distributed systems this has been the policy since version 6. However for Z/OS jobs they do not add the +1.
    ________________________________________________________________
    Q:  how can I increase archive view point to 30 days?

    A: For archived nets, they are controlled by the parameters called MAXOLDDAY and MAXOLDNET.
    ________________________________________________________________
    Q:  Under CTM/server with fix pack 7, should the new parameters (PARALLEL_LastNO?, ...) be automatically populated under CCM, or would it need to be added manually?

    A: Those parameters will need to be added manually.
    ________________________________________________________________
    Q:  Can it be New Day be setup to ignore the fact the job is on Hold and be removed or done via a utility?

    A: No. New Day can not be configured to ignore that a job is on Hold and remove it.
    ________________________________________________________________
    Q:  What method is to recover if  New day failed say because of Oracle memory issue or for any other issues? How to do troubleshooting?

    A: If New Day fails, the best method to recover is to:
    1.  Use the ctmlog to determine what stage of New Day failed
    2.  Depending on the stage, you can run ctmudchk to re-run the SYSTEM user daily if needed.
    ________________________________________________________________
    Q:  Hi, will pre-ordering jobs be synced before normal New Day time?

    A: Yes – if there are any changes to jobs they will be synched before New Day.
    ________________________________________________________________
    Q:  What is default of SYSTEM_DAILY_THREADS? DOWNLOAD_THREAD is 3. If there is only 2 CPU, should these values be lowered to 1, or leave them at default?

    A: The default for SYSTEM_DAILY_THREADS is 4. The formula (# of CPU’s -1) is only to give you the ability to control the amount of CPU that the threads will use and keep the threads from using all of the CPU. If you don’t have any issues, then you can leave this at the defaults.
    ________________________________________________________________
    Q:  I’m not the admin of control-m, so how do I know how long the New Day order takes on daily bases?

    A: You will need to run the command ‘ctmlog’ or ask the admin to run it for you. You can focus on the CD subsystem which is the one for New Day. For example, you could run:
      ctmlog listss CD 20140812 0000 20140817 0000 >newdaylog.txt
    Then you can look at the New Day started/ended messages.
    ________________________________________________________________
    Q:  How can I retain jobs running cyclic with cyclic frequency in days in Enterprise manager without getting purged out?

    A: You will need to use the combination of the CYCLIC_MAXWAIT and MAXWAIT parameter to keep these in the AJD.
    ________________________________________________________________
    Q:  We have multiple CTM servers.  Can one of the CTM servers use a regional system time (Malaysia), and have the new day run based on the regional time for the CTM server, which will be different from all other servers (CTM and EM)(CST)?


    A:  Yes- Servers use whatever timezone you wish.  They don't have to be the same.  New Day runs based on the system time of that host, so can be in any zone or time. 
    ________________________________________________________________
    Q:  Which are the reasons for creating several user dailys?

    A: There are many possible reasons.  One might be to order time zone jobs, another is to spread the load, also to bring in jobs only at a specific time.
    ________________________________________________________________
    Q:  Is pre-ordering applicable only in case of New Day? Or it will occur for user daily that runs during a day?

    A: Only for the New Day.  
    ________________________________________________________________
    Q:  will there be any performance issue due to pre-ordering

    A: there shouldn't be much extra processing.  Pre-order should greatly shorten the actual New Day order time, and the pre-ordering 1 hour before will be minimal . We have not had any performance issues reported.
    ________________________________________________________________
    Q:  How to enable pre-ordering for Custom User Daily Jobs?

    A: It is not possible to do pre-ordering for user daily’s.
    ________________________________________________________________
    Q:  What happens if a jobs scheduling criteria is changed just prior to new day time and pre-ordering is enabled?

    A:  If the job scheduling criteria is changed after the pre-order is done, the job information is removed from the pre-order, and the job will be ordered normally at New Day time.  
    ________________________________________________________________
    Q:  so anything changed during that hour will be copied also

    A: Any updates during the pre-ordering time will be updated in the pre-ordering.
    ________________________________________________________________
    Q:  Do you have a maximum recommended number of jobs that can be ordered in a single new day?

    A: The maximum will depend on the processing in your environment. You can monitor the ctmlog to determine how long New Day is taking and if you use pre-ordering, if the pre-ordering is finishing in time. If you need more time to process jobs you can extend the amount of pre-ordering time. 
    ________________________________________________________________
    Q:  Can you explain if this data in database need to be flushed out manually?

    A: The conditions, statistics and the Agent SYSOUT needs to be routinely purged. 
    _______________________________________________________________