1 2 3 Previous Next

BMC Control-M

137 posts
Share: |

On Wednesday April 22nd 2015, Neil Blandford will demonstrate how to use Agentless technology to access unsupported platforms and reduce agent maintenance. 


There will be a live demo of Agentless setup for both SSH and WMI.  There will also be a Q&A after the demo.


Registration is now open here!

Share: |

-by Joe Goldberg, Control-M Solutions Marketing, BMC Software Inc.


Whether you are already doing hadoop or just trying to learn, the #HadoopSummit in Brussels April 15-16 is for you. Snap4.pngThis is the premier community event in Europe with over 1,000 attendees expected. There are 6 tracks with dozens of sessions covering everything you should be thinking about as you try to determine if Hadoop is right for your organization or how to best implement it if you are already committed to the technology.


This event is also a great opportunity to learn how you can build Big Data Insights faster, as much as 30% faster. And once you get them running, make sure they operate more reliably so developers can sleep at night and be productive in the morning instead of being bleary-eyed from fixing problems all night.


We are joining our partner @Hortonworks, who is hosting this event. Visit @BMCControlM at Booth 12 and come listen to my session; Oozie or Easy; Managing Hadoop Workflows the EASY Way.


The postings in this blog are my own and do not necessarily represent the opinions or positions of BMC Software

Share: |


In today's complex environments, Control-M can be configured for security, remote access and multiple production and testing landscapes.


On Wednesday, March 25, 2015, Ted Leavitt will discuss and demonstrate the following:

  • Setting up clients to work with multiple EM environments(Prod, test,dev, …)
  • Understanding and configuring the Naming Service( CORBA) in Control-M
  • Considerations for VPN and firewalls
  • Configuring for a virtual and clustered environments


Don’t miss a live demo of configuring for these environments.  There will be a Q&A after.

Registration is now open here!


Control-M Workload Automation icon.png

Share: |

Interest in Big Data has gone global with organizations around the world aggressively jumping onto the Hadoop platform. The leader in open source Hadoop is Hortonworks and BMC is proud to be their partner. We have just completed joint promotion of Hadoop workload management with BMC Control-M at #Strataconf in Santa Clara and will continue to spread the word of Control-M workflow management for Hadoop through our participation in the Hortonworks Modern Data Architecture RoadShow. In the last several months this program generated great interest with sold-out attendance in Atlanta, Dallas, New York, Boston, Washington DC, Chicago, Seattle and San Francisco and London.HadoopWorldMap.png


The global tour continues with events scheduled for:

  • Paris – March 3
  • Munich – March 5
  • Tokyo – March 10
  • Los Angeles – March 24
  • Houston – March 26


Each event is a full day of Hadoop information for both business and technical audiences focusing on how organizations can unlock the potential for Hadoop including case studies and a customer speaker.


The cost of attendance is either free or a nominal $99. This makes the event very accessible so the demand will be high. Be sure to register using this link as soon as you can.


  Come and join us to learn how Control-M can help your organization harness the power of Hadoop. Accelerate deployment of applications, run them with the highest level of service quality and gain the agility to quickly get from Big Data to Big Answers to power your business


The postings in this blog are my own and do not necessarily represent the opinions or positions of BMC Software
Share: |

On January 7, 2015 BMC held a webinar titled “Deliver Big Data Applications Faster” where we presented some of the Big Data project challenges that many companies are having these days. We shared the experience we have gained over the past couple of years by helping customers to address these challenges. We’ also discussed how BMC Control-M can help deliver Big Data applications faster and help you make your Hadoop projects more successful.


To watch the recorded webinar, click here.


Here is a transcript of the questions and answers from the event:


Which Hadoop distributions does Control-M support?

Answer: Control-M for Hadoop works against the native Apache Hadoop APIs, so it supports all the distributions and all their releases. We do not yet support the Hadoop 2 release for Windows (only Linux is supported), we have not received any requests from customers to support it yet…


What if I’m running applications that are not supported by Control-M, can I still get some of these benefits you described?

Answer: Yes, definitely. In reality there are endless amount of applications out there and while Control-M can support many of them using CLI’s and WebServices, we are working these days on a new tool that will allow creating “custom” job types with a “native” interface to the application. You will be able to share those “custom” job types with an online community or download job types that were created by other users. But regardless of those custom job types, if the integration with applications that are not yet covered by Control-M is performed via scripts, you still get many other benefits such as the dependencies between jobs, forecasting, SLA management, self-service and mobile access, notification, output analysis and much more. A lot of what is traditionally included in wrapper scripts is provided for every job in Control-M so your scripts can be much more simple and shorter. Just avoid using the native application schedulers to ensure you have an enterprise end-to-end view of the entire workflow, not silos or islands of automation.


We already implemented a bunch of our workflows with Oozie. Is there anything you provide that could help us switch to Control-M?

Answer: The Control-M conversion tool can import Oozie jobs to Control-M very quickly. Even if you are not using Control-M yet for your Hadoop jobs, and you only want to see what those job flows will look like in Control-M, you can do the import, see how easy the process is, and get a better understanding of the Control-M for Hadoop capabilities.


Is the communication between Control-M and Hadoop secured?

Answer: You can configure Kerberos Authentication so credentials are encrypted. This has actually been a major requirement from several customers who told us that such authentication is mandatory.


Do you have any examples from customers that you can share?

Answer: We have a couple of success stories on YouTube that you can watch, and we will soon publish a couple of additional ones. In short, one of our success stories is with a company named MetaScale. This is a company which is owned by SEARS Holdings. They took the same Hadoop based technology that they originally developed for SEARS, and they now offer it to other companies as well. For SEARS they analyzed customers shopping trends using Control-M and Hadoop. They were specifically impressed with Control-M's ability to integrate with so many platforms and applications, and the single point of control. The other success story is with a company called ChipRewards. They are providing Big Data services mainly to the healthcare industry. If you watch their video on YouTube you will see them talk about SLA management and how Batch Impact Manager helps them to meet their batch deadlines.


MetaScale Videos on YouTube:

ChipRewards videos on YouTue:



Do you have any other questions on BMC Control-M for Hadoop and about accelerating the delivery of Big Data projects? Post them here or contact me at tom_geva@bmc.com.


Additional Resources:



dilbert big data.gif

Share: |

Informatica Job Form.pngAre you still automating Informatica workflows with the PowerCenter internal scheduler? Or are you using homegrown scripts to schedule Informatica workflows with an external scheduler? Now is the time to boost your integration with the new release of Control-M for Informatica, and enjoy all the benefits of the best workload automation solution in the market!


BMC Control-M for Informatica provides a simple and easy way to automate Informatica workflows and integrate them with other enterprise applications (such as Hadoop and SAP), technologies (such as WebService, database processes and file transfers), and batch activity that runs on various platforms (mainframe to distributed and everything in between). It provides single point of control for all your workloads (including Informatica), SLA management, secured authentication, automatic error recovery, and Self Service access via web and mobile devices.


In July 2014 Gartner published their Data Integration Magic Quadrant where Informatica was positioned as the leader vendor in the data integration market. The Control-M for Informatica solution is one of the most widely used among all Control-M application plugins.


BMC has recently released version 8 of Control-M for Informatica, which includes the following enhancements:

  • Secured authentication via LDAP
  • Start or rerun an Informatica workflow from a specific task
  • Schedule a single task of an Informatica workflow
  • Access from Control-M to the log and statistics information of a specific Informatica session
  • Job type forms for BMC Control-M Workload Change Manager
  • Support for Informatica PowerCenter v9.6.
  • New platforms support including Linux 64-Bit, Windows 8 Windows Server 2012 and others.
  • Support the ability to schedule concurrent executions of Informatica workflows and the ability to specify instance name attribute value.
  • Installation of Control-M for Informatica on Windows clusters.


These new Control-M enhancements provide users better control on their Informatica workloads, offering increased productivity, and faster ways to recover from failures. If you are already using Control-M for Informatica - please share your experience with us, tell us how it helps you to automate and manage Informatica workloads, and let us know which other Informatica related functionality you require.

Share: |

Even with Control-M, problems can still occur in your batch environment.  It’s how quickly you recover that matters.

I have had the tremendous fortune and pleasure to have worked with Control-M since 1999.  I have seen firsthand how businesses benefit by using it to manage their workload environment.  But even with Control-M in place problems with jobs sometimes still occur.  However, with the addition of Control-M Workload Archiving remediation and recovery from those problems is quicker and more available than ever before.


Workload Archiving automatically collects and archives job log and output data and makes that data easily accessible.  It is architected to allow years’ worth of data to be stored where it can be retrieved almost instantly.  The data contained within the archive can be accessed (assuming permissions allow) from both the Control-M GUI client as well as from Control-M Self-Service and the architecture of Workload Archiving is meant to have little to no impact on the overall performance of the Control-M environment.


Archive policies allow administrators to easily determine what type of data to archive (job log and/or output) and the retention period for that data.  Fields such as Application, Sub-application and Folder, along with job status (OK-Not OK), can be used to create subsets of archived data with corresponding retention lengths.  For example, all jobs that end OK that have an Application of “Warehouse” can have their log retained for a period of 6 months, whereas jobs that are part of the “OnlineInventory” Application that end Not OK can have both log and output retained for 24 months.


With Workload Archiving access to potentially years’ worth of job log and output is as close as a couple of clicks away.  Within seconds of a job failure you can compare the output from the current version of the job with the output from a successful version from a year ago (maybe that is the last time the job ran).



The advanced search option lets you search for a text string that might be present in any prior day's log or output.  Or use any of the fields you see in the screen below to help narrow down what prior day data you are looking for.



If you are already using Workload Archiving let us know how it helps you shorten the troubleshooting of job failures.  Problems happen.  It's how you recover from them that matters.  Introduce BMC Control-M Workload Archiving (watch Workload Archiving video) into your Control-M environment and be better prepared to stay cool in the heat of the battle!

Share: |

-by Joe Goldberg, Control-M Solutions Marketing, BMC Software Inc.


Anybody familiar with Kerberos? How about Hive Server 2 or the Streaming API or Tajo? Great if you are, but it’s OK if you're not. Ask 100 IT folks and most likely the majority won’t know either.dreamstime_30.png


So why is it a big deal that BMC Control-M has just announced support for these technologies especially if relatively few are using them today? Thought you’d never ask!


Most would agree that Hadoop and Big Data are some of the hottest terms in the IT world today. And even if many organizations still are just kicking the tires or scratching their heads about how exactly to operationalize this technology, many are already deploying it and getting massive value from their investments. And the big news is that by 2020, this will be a $50 Billion market which means almost everybody will be using this stuff.


Now for the sixty four thousand dollar question. When you get around to evaluating a new technology, do you want to bet on a vendor that is a laggard and just recently joined the party or on the world’s best solution that’s been supporting that technology for years with deep experience and expertise?


Ok, yes that was rhetorical.


If and more likely when Hadoop is on your plate, you should know that Control-M for Hadoop was originally released in June 2013.  And since then Control-M for Hadoop has seen significant global adoption across multiple companies and industries driven by continuous delivery of valuable enhancements. As of this latest update, support is provided for:


And yes, the Big Data world is increasingly populated with new “animals” and projects on an almost-daily basis. Rest assured that the BMC Control-M team is fully committed to supporting this exciting and expanding ecosystem.  If you want to extract every benefit for enterprise batch processing with Hadoop today, and be assured of having the best of all possible worlds as you expand and manage this composite business workload into the future, call on Control-M.


Read, watch and learn more by visiting here.

The postings in this blog are my own and do not necessarily represent the opinions or positions of BMC Software


Share: |

On Wednesday January 28th 2015, Octavio Vazquez will explain how to configure and use Control-M Self Service. Self Service enables web and mobile access to view, order and perform actions on your jobs. This webinar will demonstrate how to create the services and authorizations to allow access to your Control-M environment.


There will be a demo of using Self Service from a browser and also the smartphone Self Service.


Connect with Control-M Webinar: Self Service Advanced & Mobile on January 28, 2015 @ 9:00am US Central Time


                        Register using the following link:  http://bit.ly/1AjonYs



Hope to see you there!

Share: |

With the start of the New Year, there is a lot of reminiscing about the previous year.  This often comes in the form of top 10 lists – such as the top 10 movies for 2014. 

1-7-2015 4-31-10 PM.png

and the top 10 smart phones for 2014

1-7-2015 4-56-54 PM.png



There are those that provide us what they consider the major events that happened around the world during the year:

1-7-2015 4-28-31 PM.png


So I thought I would leave you with a view of what Control-M customers had to say in the year 2014.

Here are results from the BMC Control-M 2014 Survey. 


1-7-2015 4-34-06 PM.png


A few highlights:

  • Nearly 60 percent of organizations are managing workloads across mainframe and distributed systems.
  • Workloads continue to be on the rise, mostly due to new applications and business growth.
  • Adoption of self-service has nearly doubled year over year.


Enjoy the look back. 




Tom Geva

Depending On You

Posted by Tom Geva Jan 4, 2015
Share: |

How awesome would it be if you could see job dependencies on your mobile device?


Imobile flow with iphone frame.pngt’s been about 4 years since we released the first version of the Control-M Self Service mobile app. We started with an iOS app and then added support for Android devices as well. The next step was to make our app “tablet optimized” taking advantage of the additional real-estate available on devices with larger screens. Over time we’ve made many usability enhancements, including the highly requested features of the ability to order batch services from the mobile app and the ability to deploy the app using Mobile Device Management (MDM) software.


But there’s always been one capability which users have been asking for that was not available - at least not until today!


If you guessed the missing capability was the ability to see dependencies between jobs in a graphical job flow on your iPhone or iPad – you were right.  Today we are excited to release Version 6 of the Control-M Self Service mobile app that makes this a reality!!  And let me tell you – it is absolutely awesome!


You can download this version for free from the Apple App Store or from Google Play, and give it a try by connecting to our Control-M Self Service test-drive trial environment.


There are many more capabilities which we plan on adding to our mobile app, but if you are already using it – let us know which features you like the best and what functions you would like us to add next (and why)…





Share: |

If you haven't heard about Control-M's Workload Change Manager, check out our Overview and Web User videos to get an idea what it's all about.

Overview video:


Web User video:


Share: |

On Wednesday December 17th 2014, Ronnie Cabrera will explain how to use

autoedit variables with Control-M. Where they are documented, what functions

can be used with them, and how to use autoedit variables in jobs and scripts.

There will be a demo of ways to use autoedit variables with Control-M.


Connect with Control-M: Using Auto edit variables

December 17, 2014 @ 9:00 am US Central Time


Register using the following link:


Share: |

If you want to get a quick overview of Control-M Workload Archiving, take a look at our video on YouTube: https://www.youtube.com/watch?v=-zF4yDYE8xs

Or, watch it from here:

Share: |

Q&A for Arthur Yates webinar on how the Control-M/Server to Agent connection works and what to do if an Agent loses connectivity and goes "Unavailable". The recording of this webinar is available at:


This is also available on YouTube at https://www.youtube.com/watch?v=KnI9SQOfbQ4
Q: what where the diagnostic commands that were used?

A: ctm_diag_comm {agent_name} on the CTM Server
   ag_diag_comm on the agent
Q: What's the difference between ping to server platform and agent ping to server
To clarify, when we execute ag_diag_comm, we see results for "System ping to Server Platform" and "Agent ping to

Control-M Server". 
What is the difference between these tests

A: A ping uses the OS ping through a default port (sometimes not allowed)
Our agent ping to the server uses the port we assign with Agent-to-ServerPort Number.   
Our ctm server ping to the agent uses the port we assign with Server-to-Agent Port Number.
Q: Is the sleep interval, the 15 minutes, per job or is it a consistent interval? 
In my experience, the 15 minute delay when the agent cannot communicate to the server is per job and will always be

15 minutes.

A: 15 minutes is the maximum.  This is the Track All done by the Server as a fail safe to check all jobs in the AJF
Q: What would be the protocol for 6.3 ..08 ?

A: Unfortunately, Control-M/Agent v6.3 is unsupported.
Q: Even though the agent to control-m server failed would it return the correct value or will it show failed in the


A: It will show failure in CCM interface. You'd like to run the CTM/Server and CTM/Agent communications diagnostics

(ctm_diag_comm <agent> and ag_diag_comm respectively). Make sure ports and protocol versions match.
Q: Would you recommend using persistent for all agents with high daily throughput ie 1,000+jobs per agent when using

SSL encryption from agent to server

A: You’d typically use Persistent mode for your Agents when there’s a Firewall, Agent located in DMZ, or DNS issues.

If you place all your Agents in Persistent mode along with SSL encryption; you run the risk of running out of

connections to the Agents and the additional overhead on the Control-M/Server due to SSL configurations.
Q: Would you perform any different checks if you are investigating issues with a remote/agentless agent?

A: Because an Agentless system doesn’t have Control-M footprint, you’d perform your basic network connectivity

diagnostics, such as ping, telnet, netstat, nslookup from the agent associated with the remote host. 
Q: Is it normal to see multiple agent tracker tasks on a unix agent?

A: In later versions of the Agent like V8, this is now a multi threaded process. You have the option to

disable/enable Agent multi threading. If enabled you will notice additional Agent Tracker processes.
Q: Can we use version 8 agent configured with control-m server version 7?

A: Yes, this is a supported configuration. Version 8 Agent is supported with Control-M/Server V8 and V7.
You’ll need to adjust the protocol version. Purpose of the protocol version is to be able to connect later releases

of CTM with earlier releases of CTM.
Some advanced functionality may not be available when using a higher version of Control-M/Agent with a lower version

of Control-M/Server. However; Base functionality, is available

When can a Control-M/Agent connect to Control-M/Server of a lower version?
Q: On unix agent, is the agent services should be started with only the super user (root), it seems we can start

agent with another user for CTLM V8

A: On a Unix/Linux system the Agent can be started in root-mode or non-root mode. You use non-root mode for jobs

that are owned by a user that’s different from the one running Control-M/Agent. Here’s some info where you can

toggle between the settings using the “set_agent_mode” script on the Control-M/Agent

Control-M/Agent Install Guide
Pg.32 Enabling Control-M/Agent for non-root mode
Q: Will you have a similar webinar explaining remote hosts and how to set them up properly?

A: This is something we can certainly consider.  On Youtube we do have other videos besides Connect with Control-M,

and Remote hosts should be one of those.



Q: If an agent in the CCM shows an error "internal communication error" what steps to troubleshoot?

A: This typically means that a process is not able to bind to its listening process or did not start.  So it’s

either an issue with naming resolution (localhost) or a process did not properly start (resource not available).
Q: Does patching of Control-M agents in version 7.0 needs stop and start.

A: Yes, version 7 Agents require being stopped prior to a fix pack or patch being applied.  With version 8 on UNIX

and 8 fix pack 1 on Windows, we have what we refer to as the 'no downtime' maintenance, where you do not need to

stop the Agent.
Q: Which mode is preferable GUI (CCM) or through command line, to make these changes?

A: You can use either, however you'd like to use the CCM interface for easy configuration. If you can’t access the

components via CCM then use the command line utilities.
Q: I have a control-m agent version 8 on windows. Why is it that the sysout files are getting dumped in the agent

home directory as oppose to the sysout directory?

A: This is a unique situation which is affecting your computing environment. We recommend you opening a case with

BMC support and providing us the problematic Agent’s Health Check Utility logs along with how often the problem

happens, when did you notice the problem happening
Q: For which version is No down time required for Agent Upgrade?

A: V8
Q: What does the "Make Agent Available" in ctm_menu do?

A: If the Agent is "Unavailable", you can force it to Available manually with that option, if it has not yet been

done by Control-M/Server.
Q: Correction of my question: What's the purpose of the "Change Agent Platform Status to Available" in ctm_menu?

A: This is just an option to manually set it to Available in case the automatic process to set it has not yet kicked

Q: When do we use ctmwincfg command?

A: ctmwincfg and ctmunixcfg specifically configure Windows and UNIX settings not agent <-> server settings.  These

are actually handled like other CM's such as OAP, SAP etc.  This is documented in  the utility guide
Q: How is Router process sending status of 'job' back to CTM Server when Persistent connection is setup? Is it the

same as when Tracker process is sending the status when Transient connection is setup?

A: In persistent mode; it’s the Router process that allows CTM/Server to maintain the constant connection with

Agent. In persistent/transient mode the Tracker process monitors request status. However in persistent mode the

Tracker hands off the job statuses to the Agent Router process which then submits to CTM/Server.
Q: I have an AFT job that shows successfully ended and 100% transferred but nothing being transferred?

A: This is a unique situation which is affecting your computing environment. We recommend you opening a case with

BMC support and providing us the problematic Agent’s Health Check Utility logs along with how often the problem

happens, when did you notice the problem happening.
Q: Please show the agent logs where they reside.

A: <agent home>/proclog
Q: I noticed in your demo that on the server when you did the last ctm_diag_comm for the windows agent it showed the

agent status as unavailable. So that means things weren't working yet?

A: This took just a little while for the update to show back to CTM/Server. If there's a heavy load on the

CTM/Server this can result in slight delays in returning status info.
Q: If the agent is unavailable for a while will it eventually restart itself or going through ctm_menu and set the

agent available again?

A: You'd like to view the Agent status in CCM and if needed manually restart the Agent services. If you can access

Agent via CCM, log into Agent manually and restart the Agent services.
Q: If an agent fails and the jobs go into a white status in ctm, what's the best way to get those jobs restarted

after the agent is connected? Wait for the agent to pick up the jobs or would you need to manually restart the jobs?

A: Once the Agent communication is re-established, job statuses will automatically be updated.  Only if it is down

for 2+ hours, the Server will then set the job to disappeared and you would then have to rerun it
Q: Does it pose an issue if using transient mode going through a firewall?

A: As long as the designated ports for CTM/Server & CTM/Agent can open and close that connection to each other; you

won’t have a problem. However, if you notice a problem in communication, switch to persistent mode.
Q: What is purpose of Control-M/Agent Filewatcher under the services? When do we restart that service?

A: The filewatcher service is intended to be used with a rules file which contains instructions for the service. 

This is as compared to a filewatcher job, which can use either a specified rules file or specific parameters. More

information on the filewatcher rule file and other information regarding the filewatcher can be found in the

Control-M Utility Guide @ http://documents.bmc.com/supportu/documents/80/62/458062/458062.pdf
Q: Would you have time to go through the logs generated by the agent and how do we make sense of contents in the


A: That may be more that we can do in this type of presentation
Q: If Windows telnet is disabled, what do you use troubleshooting ports, please ?

A: You can actually use any browser, any process which reaches out and connects to a tcp port.  URL

Q: telnet is being shut off on servers due to being insecure, can ssh or another tool emulate the telnet 'port'


A: You can actually use any browser, any process which reaches out and connects to a tcp port.  URL

Q: In what scenario the jobs will go in "Unknown" state ?  How to recover this ?

A: This may mean a communication issue between the CTM/Server or CTM/Agent or the Agent services or actual host may

be down/unavailable. You'd like to check the status of the Agent system manually.
Q: In what scenario should we use persistent connection mode?

A: Typically persistent connection is used when using Firewall, Agent in DMZ, or DNS issues.
Q: I noticed you didn't have to bounce the controlm agent when you made changes to port numbers. If I were to make

a change to the CONFIG.dat file, and my agent is version 8, do I need to bounce the agent?

A: We recommend to restart the Agent services to refresh the processes. You'd like the changes made in the

CONFIG.dat file to register with the Agent system properly.
Q: Is there anything different for troubleshooting a persistent connection vs. transient?

A: You'd like to follow the basic principles we covered regarding communication issues. Run the Control-M

communications diagnostics along with the operating system network diagnostics. These utilities can help you see

problems outside of Control-M

Filter Blog

By date:
By tag: