Skip navigation
1 2 3 4 5 Previous Next


289 posts
Share This:

Do you want to visualize the status of internal and external business-to business (B2B) transfers from a central automation platform?


Learn how our newest product, Control-M MFT Enterprise B2B, provides a secure method for external business partners to transfer files to and from Control-M Managed File Transfer environments from an easy-to-use web interface and more.


In this webinar James Pendergrast will explain the architecture of this add-on and how you can get the most out of it in your organization.


This is the link on YouTube for the recorded session:


Connect With Control-M: Control-M Managed File Transfer Enterprise B2B (Version 9.0.18) - YouTube


Here is the Q&A for this webinar (Connect with Control-M: Control-M Managed File Transfer Enterprise B2B (Version 9.0.18))


Q: Is the name of the product Managed File Transfer Enterprise? Or Managed File Transfer B2B?

A: Managed File Transfer Enterprise



Q: Is it licensed separately from MFT?

A: Managed File Transfer is an additional purchase on top of Managed File Transfer (MFT).



Q: What version of EM is necessary to use MFT Enterprise?

A: Enterprise Manager must be



Q: Are we need to shut down related agent before start installation?

A: No, it must be pushed and activated while the agent is online.



Q: Will this upgrade AFT to MFT?

A: Managed File Transfer 9.0.18 can only upgrade accounts from AFT 8.2 and Managed File Transfer 9.0



Q: Are MFT and MFT B2B 2 separate products?

A: Managed File Transfer is an additional purchase on top of Managed File Transfer (MFT).



Q: Can we grant/limit access from Authorizations to the MFT Enterprise Settings?

A: The Managed File Transfer has authorizations that are specific to the transfers and access. Enterprise Manager has a separate set of authorizations.



Q: Is Gateway machine a CTM agent?

A: No, it’s a standalone process.



Q: Does the HUB install on windows platform or just Unix?

A: The Hub can be installed on Linux and MS Windows



Q: At a user group meeting I heard that the Control-M MFT B2B is not included with the licensing for Control-M MFT that the B2B needs to be purchased as an add-on is that true?

A: Managed File Transfer is an additional purchase on top of Managed File Transfer (MFT).



Q: Does MFT encrypts/decrypts files according to various vendor if yes then where are the keys stored or do we still need to use any pgp tool for that and also how about zipping/unzipping

A: MFT currently does not encrypt the file, this will need to be done with an external process.



Q: Can we create specific folders for specific external users/partners?

A: Yes, each external user is assigned to one or more folders.



Q: Can I use MFT 9.0.18 in compatibility mode?

A: No, the forms and information needed for Managed File Transfer Enterprise to work, is not available when in Compatibility Mode.



Q: What kind of penetration testing has the CTM MFT B2B been through to make sure that the Gateway through to the internal is protected from hackers?

A: Please contact BMC for results from Penetration testing.



Q: What happens if there is an overload of the interfaces such as a denial of service overload?

A: This will affect the availability of Managed File Transfer Enterprise.



Q: Does update 001 need to be installed on both the EM Server and Clients?

A: Update 001 needs to be installed on all the EM clients that access MFT Enterprise.



Q: Does the File Exchange function as a reverse-proxy?

A: Yes, it does function as a reverse proxy.



Q: What protocols does Managed File Transfer Enterprise support?

A: Currently we support FTP, FTP with SSL/TLS, SFTP, and HTTP(S) but we'll include more in future. If you need a specific protocol that isn't currently supported, please open a ticket, so we can document the request. We are always looking for input for what is requested.



Q: What reporting is available for file transfers?

A: You can use the reporting facility and the mftreportcli to create reports. There are 2 new reports available.



Q: Are there dependencies between MFT B2B and MFT?

A: Managed File Transfer is an additional purchase on top of Managed File Transfer (MFT).



Q: We only have AFT 8.2, could we use MFT B2B with AFT 8.2?

A: MFT is additional functionality on top of Managed File Transfer 9.0.18.



Q: Does search of files at dashboard working also for files, that names in definition consist variables?

A: Wild cards and partial files names can be matches when searching for a file.



Q: Is the webpage interface the only interface external users can use, is there any sort of cod line or other interface they could script around and automate with

A: Yes, external users can access their files via FTP over SSL, SFTP, and REST over HTTPS.



Q: Will AFT work as normal, or does this replace AFT totally?

A: Managed File Transfer Enterprise replaces AFT when installed.



Q: Can external users download files via B2B?

A: Yes, via FTPS, SFTP, and REST over HTTPS.



Q: Can this be installed on either Windows or Linux?

A: The HUB can be run on Windows or Linux. The Gateway must be installed on Linux.



Q: AFT and MFT are different license?

A: Yes, they are separate licenses. Managed File Transfer is an additional license on top of Managed File Transfer.



Q: What is the timeline for those who are currently in version to upgrade to B2B Enterprise?

A: Managed File Transfer 9.0.18 is currently available, and can be deployed once EM and Control-M/Server are version 9.0.18.



Q: The notification sent when files arrive, can it contain the file name that arrived?

A: Yes, the notification contains the filename.



Q: Is the hub installed on the Control-M/Server or Control-M/Agent?

A: Hub is installed on a Control-M/Agent.



Q: Is MFT available for Windows?

A: Yes, but gateway only available for Linux



Q: Is there a limit on the file size which can be transferred? Also does it allow to transfer multiple files at same instance (like 100 at a time)?

A: No, there is no limit coded, as long as the servers involved can handle the traffic.



Q: Is it possible to set up B2B failover?

A: The HUB and Gateway can be configured to run on existing HA platforms for redundancy.



Q: To exchange files with another multiple companies in a managed way, does Ctrl-M need to be installed on both ends, or just the "server" side?

A: Any client supporting FTP over SSL, SFTP or supporting REST over HTTPS can exchange files.



Q: Can external users download files via B2B?

A: Yes



Q: Will existing defined AFT jobs on previous versions still work seamlessly?

A: Yes, as long as the previous version of AFT was previously running 8.2.



Q: Can the reports be used for the AFT transfers existing already or only for the installed B2B?

A: Yes, the repots can be customized to only show MFTE transfers.



Q: Can external user use regular FTP client to upload/download without using web interface?

A: Yes, he can use ftp or sftp client.



Q: Can CTRL M MFT Agent be installed on windows too? If not, when are we going to have a MFT Agent for windows?

A: Yes, Managed File Transfer supports Microsoft Windows.



Q: How did Bob at ACME get the logon link and password?  Who manages the password changes?  Is this automate?

A: The administrator of MFT Enterprise created his account and sent him his credentials, and can managed SFTP key.



Q: Does MFT come with 9.0.18 and you would just add on the MFT B2B?

A: Managed File Transfer is an additional purchase on top of Managed File Transfer (MFT).



Q: Does the B2B gateway process run as root or installation defined user?

A: Can run as any user with proper access.



Q: How is the alert management in case of failures?

A: Please contact BMC for further clarification on this question.



Q: Is it possible to transfer files from REST Service API without creating file transfer job to external users using MFT web interface?

A: Yes



Q: Virtual folders are on gateway machine or hub machine?

A: On hub machine. There is no information stored on gateway.



Q: Can we set the dependency flag once file is pulled by B2B or pushed by Vendor?

A: Please contact BMC so we can further understand the request.



Q: What user on hub machine owns the files and folders of the virtual folders?

A: These are owned by the agent user, but the FTP access is handled within the FTP server, and not OS users.



Q: Can the hub communicate through a hardware load balancer to have multiple endpoints?

A: Please contact BMC so we can understand the requirements.



Q: Is there a conversion utility for converting existing AFT jobs to MFT B2B?

A: The AFT must be upgraded if not already running on version 8.2.  At that point MFT 9.0.18 can be used to upgrade this installation.



Q: Existing AFT jobs will be automatically displayed in MFT dashboard?

A: Yes, all transfer jobs run through the job or on a MFT job in this environment are displayed don the hub.



Q: Can the MFT B2B be used to receive patches from BMC?

A: Not at this time. 



Q: What is the time for connection profile? Can this be changed?

A: Please contact BMC so we can receive clarification on this question.



Q: We have many files about 5 GB or 15GB file transfer. Do we know how fast file can be moved with MFT Enterprise?

A: MFT Enterprise benchmarking is available on request.


Share This:

BMC digital IT powers 82% of the Fortune 500 companies. Our innovative software solutions enable businesses to transform into digital enterprises for the ultimate competitive advantage. Control-M is transforming digital enterprises across the globe and customers rely on Control-M every day to keep critical systems driving their business, running smoothly. Whether it be financial services, information services or banking, Control-M is changing the lives and businesses of those who use it, and is behind the scenes of happy customers all over the world.


Raymond James Financial manages $500B in customer assets with optimized workload automation

Raymond James, a regional investment and financial planning services provider, has become a leading international financial services firm with over $500 billion of assets under their administration. Raymond James serves nearly 2.7 million client accounts in more than 2,600 locations worldwide. Over the past 10 years they have grown exceptionally and the emergence of digital and mobile technologies have increased the importance of their IT organization getting things done faster. Control-M manages RJF’s nearly 2 million monthly jobs across hundreds of applications that access the company’s data warehouse and consolidated data store. Nightly processing ensures that senior management and their 6,500+ financial advisors have the data they need each day to help clients with investment decisions. Control-M is their primary tool to identify, escalate and remediate issues that might delay their batch processing. Simplified monitoring, self-service, and predictive analytics has helped their IT organization absorb a 42% increase in monthly job executions over the past year and Raymond James audit prep now only takes a couple of hours where it previously took two to three weeks. “With Control-M, we can look at applications across the enterprise, identify recurring issues and inefficiencies, and work with people across the organization to figure out how to make things better.” – Chris Haynes, Manager of Workload Engineering, Raymond James Financial

View the Raymond James Customer story video here.


RailInc leverages big data and automation to help keep 1.6MM railcars rolling across 140K miles of track

RailInc, an industry leader for railroad IT and data services headquartered in Cary, North Carolina, supports railroads and their customers with essential information to improve safety and optimize rail operations. RailInc has implemented Hadoop for storing, processing, and analyzing data captured from disparate sources. Control-M supports programs like Railinc’s Asset Health Strategic Initiative, which develops tools that enable customers to track equipment usage, identify equipment issues for timely repairs, and safely and efficiently coordinate the movement of millions of railcars. Control-M automates the processes that support analysis of data of 1.6 million railcars across North America. RailInc processes 11 million data points daily and they are expecting to double their growth in data volume from 50 to 100TB in the next three years with the help of Control-M. "The order in which we bring in data and integrate it is key. If we had to orchestrate the interdependencies without a tool like Control-M, we would have to do a lot of custom work, a lot of managing. Control-M makes sure that the applications have all the data they need." - Robert Redd, Release Engineer, RailInc

View the RailInc customer story blog by Robert Redd here.


Itaú Unibanco transforms banking with new digital services

Itaú, the 10th largest bank in the world, and the largest financial conglomerate in the Southern Hemisphere has over 94,000 employees, 4,000 branches and 46,000 ATMs that serve a global customer base. Over the last decade, significant advances in mobile technologies have led to increased consumer demand for new digital-first banking services. Control-M is the bank’s primary digital business automation platform, processing over 14 million jobs per month and automating diverse batch application workloads for transactions in retail locations, through ATMs, online and on mobile devices. Itaú Unibanco is leading the industry with the new client-centric banking services it’s rolling out. The bank now opens almost 10% of its new accounts directly through its mobile application. “Control-M is a very important tool that we have. If Control-M stops, the bank stops.” - Leandro Araujo, Head of Production and IT Services, Itaú Unibanco

View the Itaú Unibanco customer story video here.

Share This:

Do you want to visualize the status of internal and external business-to business (B2B) transfers from a central automation platform?


Learn how our newest product, Control-M MFT Enterprise B2B, provides a secure method for external business partners to transfer files to and from Control-M Managed File Transfer environments from an easy-to-use web interface and more.


Please join us for the next Connect with Control-M webinar on Wednesday March 7th when James Pendergrast will explain the architecture of this add-on and how you can get the most out of it in your organization.  We’ll conclude with a live Q&A session.


Register Now!!     



Target Audience: Administrator, Operator.



IMPORTANT: Each registration ID can only be used by one person. Please have all interested participants register individually.

Share This:

Using cloud technologies can be a daunting task, especially with the ocean of choice that is now available to the modern enterprise. One thing that can be leveraged from the multitude of cloud providers is the ability to create Big Data clusters with Hadoop for processing information in the cloud, but without spending the large sums of time and effort required to house the clusters of servers on-premise. More importantly, the clusters don't need to be running 24/7 either, and effectively only need to be spun up on-demand for when processing is to occur. This is something that Control-M can handle easily.


The AWS Use Case


AWS offers several services for using Big Data and for data processing in general, but one service stands out, which is called Elastic Map Reduce. With EMR, users can spin up clusters of any size with Hadoop and various other tools pre-installed. Furthermore, users can not only make use of the AWS CLI toolset to perform actions in the cloud, but more importantly can tie the calls to AWS into the jobs they run in Control-M, either as an embedded script, command, or script file. This allows for total flexibility when using AWS. Control-M also has native integration to AWS, using the Cloud Control Module, whereby a Control-M Agent can interact with any AWS account, and perform actions on EC2 instances that are running, or launch new ones from templates, as examples.


Big Deal


So, what does this mean for data scientists and business intelligence professionals working to leverage the power of Big Data in the cloud? Well, using an enterprise-grade scheduling solution such as Control-M, users can now employ services in AWS in a streamlined manner, and use the output of what AWS provides to take dynamic action inside of Control-M. EMR is a powerful tool that, if properly leveraged, can result in delivering real valued results quickly, all while minimizing costs. The benefit is that the clusters only need to exist for as long as the processing needs to occur, and can then be eliminated, thus the notion of "ephemeral clusters". By processing what is needed, but only keeping the results, users effectively circumvent the need to keep these machines running 24/7, and still derive value for their company. These flows can also be triggered dynamically, as they are now service-oriented, instead of being regularly scheduled flows.




What if every day a series of files are received, and need to be treated, but these files are massive? Do you have the steps already built into your schedules to treat them? Do you want to start leveraging AWS? With some modifications, the existing flows that make the calls to perhaps a local Hadoop cluster could be made in the cloud instead, as Control-M has the ability to run anywhere, be it on-premise, off-premise, or multi-cloud, depending on the need. You could not only treat the files as needed with a file watcher automatically, but could also trigger manually whenever you'd like to refresh data in reporting tables, or generate information at a point in time. With Control-M managing these steps, you have much more power at your disposal when invoking AWS.


But don't just take my word for it...


Using Control-M, we can invoke the AWS services necessary, in the right order, so that data is received, a cluster is instantiated dynamically, attached to Control-M dynamically, data is processed, results are sent out, the cluster is de-instantiated, information is streamed to a dashboard, all done dynamically by ordering a service from a smart phone, monitored by our Batch Impact Manager to ensure the service does not run overtime to meet SLAs. Technologies at play here include the Hadoop Control Module for Control-M, our Automation API for dynamic agent provisioning and deployment, our Managed File Transfer Control Module to handle files in and out, our Batch Impact Manager job type to manage SLAs, the innate ability of Control-M to pass variables between jobs and share information, our Self-Service Portal as well as Control-M for Mobile Devices for use by business stakeholders.


Taming AWS


We start by ensuring that Control-M has access to the AWS CLI in order to make calls to the AWS account where we're triggering cluster builds and machine instantiation. By invoking the "aws emr create-cluster" command, we can set up a custom cluster with all the bells and whistles that we'd hope for. This will ready a cluster, but while we wait we'll want to invoke "aws emr wait cluster-running" until the cluster is up and running to proceed to the next portion. The AWS CLI is extremely comprehensive, you can trigger almost anything in AWS using it, and can also craft a custom Application Integrator job that can do the specific things you need to do, effectively wrapping the calls and abstracting the runtime into the Control-M WLA or Web client.


File Transfers


You might want to pipe some files in from outside of your AWS installation, and so MFT jobs would be ideal here. You can leverage FTP, FTPS, and sFTP transfers to bring files in from partners, or from other systems in your multi-cloud environment. These files can be ultimately piped into AWS S3 or HDFS. What’s great with the Control-M MFT module is that you can create jobs that will create dependencies for your successor jobs that are based on files being successfully delivered for ingestion. Here I set up a simple transfer from Azure, since that’s where one of our partners keep their data, and bring it into our server to be ultimately pushed into S3. Hadoop’s CM can actually reference S3 bucket files and pull them into HDFS for processing.


Big Data Workflows


Control-M’s Hadoop CM can install itself on the leader node of Hadoop clusters and control the flow of HDFS, Yarn, Hive, Sqoop, and most other common binaries found in the Big Data world. With tracking for these kinds of executions, and then the passing of information between jobs and workloads, you can effectively take a platform-agnostic stance when integrating your various disparate platforms together to achieve the results you’re looking for. In this case, we’re just executing some HDFS directory creation commands, some HDFS movement commands, pulling data in from an S3 bucket, and are all pulled into HIVE tables, where I run some very simple analysis. The results are emailed back to me, and the cluster is wiped away.




Agents can be deployed an un-deployed as needed with Control-M, which makes this kind of ephemeral instantiation a reality. Services like these make Control-M an ideal solution to remain flexible in a world where infrastructure is as malleable as putty, and only running servers for as long as they’re needed is a reality, such as with containers. The Hadoop control module for Control-M is the only CM we make that needs to actually be installed physically on one of the application servers, in this case the leader node of the Hadoop cluster. With the Automation API, all we do is call the necessary commands to go out and pull the packages to the server for provisioning, bringing the agent bundled along with the CM as well, and it can all be detached and removed when done.


controlm - Control-M Workload Automation.jpg  controlm - Control-M Workload Automation (2).jpg

ctm @ controlm homectmscripts.jpg




With the support of streaming functions, you can get the information you’ve built to the dashboards that need it, all as part of the workflows that have been built. This is ideal for visibility, and can force the refresh of information after every run, which can show you real-time information about the data you are collecting, and gain insight into trends that could create a competitive advantage. You can pipe this kind of stuff to dynamic dashboards that can show data loads, throughput, areas of interest, you name it. Perhaps you’re running an ELK stack, and are piping information out to it so that it then takes it and performs trend analysis for you.




All of this can be triggered by business stakeholders if needed, as services, leading to the workflows running on-demand, and refreshing data as needed. Real-time insight that can be called on-demand is a powerful concept, but is a reality when using Control-M to manage these kinds of flows. As mentioned before, you’re on the train coming to work in the morning, you see an email come in noting that the last file transfer you were waiting for overnight has completed, you make sure you’re on VPN with your iPhone or Android device, you connect to Control-M via our mobile app, and you order in your EMR flow in transit so that when you arrive in the office and sit down for your coffee, your jobs are done and the results are delivered.


Control-M Self-Service - Google Chrome.jpg


SLA Management


Take the services that were declared, and were made usable for business stakeholders and tie SLAs to them, so that not only can you have Control-M trend the runtime of the services of these workloads to report on slowdowns, you can also catch problems before they occur. Control-M has these features built in, allowing for long-term analysis of the workloads that stretch past Big Data and out to the rest of the enterprise as well. What's great is that the batch impact manager, while already able to take dynamic action based on a service runtime, will automatically create a service for you when ordered in. This is key, you want to make sure that when you order your flows in, that you’re not starting to creep in terms of delivery time, BIM will track this kind of thing for you.

Control-M Self-Service - Google Chrome (2).jpg

To Wrap Up


Since Control-M can be tailored to any situation, invoking AWS to achieve ephemeral clustering is a reality, and one which we are seeing more and more customers take advantage of. The possibility of running only what you need is a major advantage over classic always-on paradigm of hosting data lakes. Control-M with its massive flexibility and toolsets that allow for dynamic integration is an ideal choice for managing any automation that occurs in the cloud.


I always like to say that the triggering of the job or the action itself is only a tiny part of what makes up Control-M. The rest of the “bread and butter” of Control-M is what really seals the deal, the on-do actions, the condition passing, the alerting, the SLA management, the ability to play between hosts, the archiving and auditability, everything else that is brought to the table. Being a 3rd party arbiter of enterprise workloads is a powerful thing, I suggest you bring some of that power over to the public cloud and start trying it out!

Share This:

ControlM_Twitter .png

It’s that time again. As VP of Operations you’ve just been handed a change management request form for hardware/software maintenance. This time it relates to a workload automation upgrade. On the form, the checkbox for “critical services interruption” is selected, and the “expected downtime” assessment value is high enough to potentially affect operational efficiency. And to top it off, the budget requirement doesn’t quite fit in with the latest cutbacks handed down through organization. For all these reasons (and the fact that upgrades like this require a lot staff time), you know you’ve got to do some research before giving approval. While inspecting the upgrade process history, you find that past workload automation upgrades were painful, to say the least, and resulted in unplanned downtime of critical applications.

So, how do you ensure this upgrade will go smoothly? What must be done to avoid critical interruptions that may adversely affect your KPIs and budget? If you struggle with these questions every time you need to upgrade your workload automation solution, here’s one more reason you should switch to Control-M!

Control-M 9.0.18, the latest version of BMC’s Digital Business Automation solution, features near-zero downtime in-place upgrades. Forget about the tedious, expensive and risky upgrade process you’re used to. You can upgrade Control-M and access all the latest features in minutes.


How does it work?

Here’s how Control-M 9.0.18 simplifies the upgrade process:

First, it reduces the upgraded downtime to almost zero. That helps you maintain business continuity and maximize service availability. It also accelerates the upgrade approval process. In beta, customers reported that negotiation activities for the proper upgrade window could be reduced by 50-70%.

Second, it reduces the time and cost of the upgrade. The new in-place upgrade method eliminates the need for parallel environments. You can now safely upgrade in the same environment you are working on, gradually moving up components. This maintains backward compatibility with the rest of the solution. By eliminating the need for a parallel environment and data migration, you will realize significant cost and time savings. This is especially true in large environments where new IPs are required and the opening of firewalls for large numbers of agents become particularly time consuming. Customers in our beta program with large data centers reported that FTE and other resource savings during the upgrade preparation phase could reach 70-90%.

Beyond simplifying and shortening the negotiation and preparation phases, Control-M 9.0.18 reduces risk during upgrade execution. If you experience issues at any time during the upgrade, the environment can be easily rolled back to the previous version until the issue is resolved.


Deploy innovation faster

Starting with Control-M 9.0.18, BMC will begin releasing major updates annually, with fix packs in between. Not only will this will help customers better plan their upgrade activities, it also showcases our commitment to investing in continuous innovation. We’re already hearing from customers that the new annual delivery model will change their upgrade strategy. Today, market dynamics are changing faster than ever! Having access to a regularly scheduled stream of innovation that is quick and easy to consume through in-place upgrades, is fundamental competitive advantage that will help IT organizations achieve true digital business automation”

Click here to learn more about how Control-M can help you deploy innovation faster.

Share This:

Learn more about the Control-M/Agent directories structure and some utilities which can help you solve issues faster and get your jobs back to running again.


As a Control-M Administrator it's very useful to know where to start looking when you have a Control-M/Agent issue. This webinar will help you understand where to look and which utilities you can use. 


Please join us for the next Connect with Control-M webinar on Wednesday January 31st when Corey Low will explain the Control-M/Agent directories and utilities usage for troubleshooting and solving issues.  Corey will also demonstrate ways to debug the Control-M/Agent and which information to provide to BMC Support when having a problem. Finally, we’ll conclude with a live Q&A session.


Register Now!!    


IMPORTANT: Each registration ID can only be used by one person. Please have all interested participants register individually.

Share This:

There’s been a lot of talk about General Data Protection Regulation, but I thought it would help to provide you with some facts.



Here’s 250 pages of GDPR information condensed into 10 bullets:

  1. Don’t have a Personally Identifiable Information (PII) data breach!
  2. Notify a legal entity of real or potential breaches within 72 hours.
  3. Remove all personal data when requested by the EU citizen within 30 days.
  4. When requested by EU citizen, within 30 days, provide all personal data and how it was used
  5. Relate the collection and processing of personal data to specific purposes.
  6. Positively verify that someone is of legal age to sign up for the service.
  7. Know where all data resides (keep records of everything).
  8. Design all systems with an appropriate and demonstrable security and process.
  9. Expand privacy accountability and liability to all partners in the ecosystem.
  10. Penalties can be up to 4% of global turnover or €20,000,000 (whichever is higher).


It’s no longer about just ‘not having a data breach’, it’s also about what the business is expected to do after a breach occurs.


So before I start, let’s clear one thing off the table, which is the question we often get, is Control-M GDPR compliant?

In short, there’s no such thing as an officially certified GDPR vendor. No vendor can be GDPR compliant, only companies can accomplish GDPR compliance through their actions and processes.


The right question is “Does Control-M allow your organization to fulfill the GDPR requirements?”

  • An enterprise is the data controller, and when it implements a software package, the enterprise still has to comply with GDPR.
  • The liability of the data processor (Control-M is a data processor!) – meaning the one who processes the data, or is ordered by the data controllers – is now broader than before.
  • The question, when choosing software, is whether it supports the GDPR requirements - from the privacy-by-design principles to the concrete requirements of handling consent per purpose.


Now let’s talk about the interesting stuff – how can Control-M help an enterprise establish the right process to meet GDPR rules.

1. Automate the Right to be Forgotten, Right to Access, Data Portability and Notify processes across all parts of the infrastructure

• Reduce cost of performing process, reduce human error, reduce time

• Integrate into the Service Request ticketing system


2. Control-M Alerts and Notifications

• Report Data breach within an enforced SLA

• Notify if there has been any problem when a job related with customer data


3. Control-M Archiving provides the process evidence to auditors in easy to understand view

• Keeps a record of what and when was executed and also who took any actions (order, cancel, modify, etc.) on them

• Contributes towards Privacy by Design


4. Automate the audit / compliance reporting process

• Reduce cost of audit process

• Use Self Service and Mobile interfaces to reduce time to respond to audit


5. Use Control-M Managed File Transfer for highly secured and controlled file transfers

• Securely manage file transfers destinations

• Track any file transfer

• Audit the troubleshoot file transfers between the organizations and 3rd parties.


6. Provide data lineage by tracking and evidencing data lineage of all activities, into a data lineage platform (e.g. Into Hadoop or into Splunk, or whichever you have)

• Meets compliance requirement to know where customer data is and is not used. Reduced cost of complying, especially for customers already using Control-M


7. Integration into Service Request and Change Management tools (for tracking, approval, handle problems, etc.)


GDPR is all about the workflow:

“Ensure ongoing confidentiality, integrity, availability, and resilience of customers’ personal data”


For more info, please visit the BMC GDPR web page

Share This:

Would you like to improve your Control-M Workflow development cycle?


Have you heard about the Automation API WorkBench?


In this webinar Ruben Villa will explain and demonstrate how to use some of the latest tools and techniques to speed up your implementation of workflows.


This is the link on YouTube for the recorded session:


Connect with Control-M: Control-M Automation API: Advanced - YouTube


Here is the Q&A for this webinar (Connect with Control-M: Control-M Automation API: Advanced)




Q: Do I need a separate Control-M license for Automation API?

A: No, Automation API is installed with Control-M/Enterprise Manager



Q: What types of jobs am I able to run using Workbench?

A: The type of jobs are the same available on the last version of Automation API: Hadoop, Manage File transfer, command, etc.



Q: What form is the workbench machine in?

A: It can be Windows or UNIX



Q: Also, is it intended to run the workbench locally or on a remote hypervisor?

A: The Workbench runs on a Virtual Box, it can be installed locally or in a remote host



Q: What level of access is required for building jobs from the JSON?  I see "emuser", which implies administrator.  Can Update users do the same or is special access required?

A: API uses ctmcli and needs to get 2 tokens for login.  One from the GUI Server (GSR) and a second from the Control-M Configuration Server (CMS). 

Because of this it needs login privileges for both as defined in the CCM under Authorizations for the user that is attempting to login.  Specifically in Privileges for "Control-M Configuration Manager" and "Control-M Workload Automation, Utilities........"



Q: Where can I get the workbench?

A: Downloads and Installation info are in:



Q: In the demo, are the jobs created in the AJF only? Can you save the job definition instead of creating a job?

A:  Yes, with the Deploy Service, once a job is deployed, it will be scheduled by Control-M according to its scheduling criteria and dependencies.



Q: How does Workbench Submission affect Task Counts?  If the DevOps is ordering jobs directly into the environment, won't this increase my task count?

A:  No, as the Workbench is a Virtual Environment.



Q: How can Automation API be used to deploy jobs to environments, not just for testing?

A:  You can have multiple environments (connections) and after testing your flows, you can submit the requests to a production environment.



Q: Can I use automation API for Informatica jobs?

A:  Informatica Job Type is not available at this moment.



Q: Is automation API available in Control-M Version 8?

A: No, Available from Control-M/Enterprise Manager



Q: Can empass be encrypted instead of clear text?

A: The encryption can be done at the application level.



Q: Does job actually run in workbench?

A: No, this is just a simulation.


Share This:

Do you need to move your existing Control-M environment to a new machine?


Would you like to automate and accelerate the procedure to keep your business running in the DR environment?


Please join us for the next Connect with Control-M webinar on Wednesday January 3rd when Andrea Carmelli will explain the process and demonstrate how to speed up the procedure to restore the hostname and configuration data in the database during disaster recovery when moving to the stand-by environment or replacing the local hostname. We’ll conclude with a live Q&A session.


Register Now!!  


IMPORTANT: Each registration ID can only be used by one person. Please have all interested participants register individually.

Share This:

Can you believe the New Year is just around the corner? What a year it has been! With one month left in 2017, be sure to join us at one of the events below or start off the New Year with Control-M.


We are excited to offer so many Control-M Seminars in many countries around the world. Spend the day with us to learn how your IT Ops, Developers, and DevOps Engineers can deliver applications and new services with the agility your enterprise demands—to drive successful outcomes for your digital business.


Explore the latest Control-M features to:

  • Accelerate delivery of services to the business
  • Quickly respond to changes and adopt new technologies
  • Accelerate application development with jobs-as-code
  • Embrace new technologies without compromising existing infrastructure



December 4-6, 2017Gartner Applications Strategies SummitLas VegasCaesars Palace
December 4-7, 2017Gartner Data CenterLas VegasThe Venetian
January, 2018Control-M SeminarCentennial, COTopgolf
January 18-19, 2018DevOps DaysNYCMicrosoft Technology Center
January 19, 2018Control-M SeminarHong KongRegistration link coming soon
January 23, 2018Control-M SeminarAmsterdamMereveld
February 1, 2018Control-M SeminarMadridRegistration link coming soon
February 19-23, 2018Control-M SeminarAustraliaRegistration link coming soon
February 20, 2018Control-M SeminarMunichRegistration link coming soon
February 22, 2018Control-M SeminarHamburgRegistration link coming soon


*The Topgolf event has been postponed to January, 2018. More details coming soon.

Share This:

Learn how to deploy Control-M 9.0.00 in the cloud using Amazon Web Services.  During this webinar, we will cover: Installation media for Cloud, Supportability, and Settings & Installation procedure.  Come learn how you can address your changing business needs by utilizing the public cloud enterprise job scheduling capability with Control-M.


In this webinar Ted Leavitt will explain and demonstrate how to deploy Control-M on AWS.


This is the link on YouTube for the recorded session:


Connect with Control-M: Deploying Control-M 9.0.00 on AWS - YouTube


Here is the Q&A for this webinar (Connect With Control-M: Deploying Control-M 9.0.00 on AWS)




Q: What is the official support policy for AWS cloud?
A: Control-M deployment on AWS and Azure is supported with current release.
We support running Control-M with internal
PostgreSQL Database
Oracle Database
PostgreSQL RDS
Oracle RDS


Q: What is minimum Control-M version and FP level required on Cloud platform?
A: Control-M/Enterprise Manager V9.0.00 FP400
Control-M/Server V9.0.00 FP300


Q: Which installation media should be used for Cloud platform?
A: BMC offers two versions of Control-M installation media. One is for regular installation use, another named with 'Control-M Version 9.0.00 with cloud support V2' for Cloud platform.


Q: How do I connect an Agent on AWS to Control-M/Server on premise host across the internet?
A: We assume the premise Server can initiate a TCP/IP connection to the agent machine (at AWS), and Agent on AWS cannot initiate a TCP/IP connection to server. The ideal solution for this scenario is using persistent connection where the Control-M/Server is connecting to the agent. The agent should be configured for "Allow communication". The only port that should be opened is the "Server to Agent" port on the agent machine as inbound.


Q: Is there a dedicated AMI in AWS that we can use that has Control-M binaries baked into it? In AWS Marketplace?
A: We do have an AMI, but we do suggest launching an EC2 image and installing Control-M in that image because of limitations of the current Control-M AMI.


Q: Can EIP be allocated for RDS Database?
A: You cannot assign an elastic IP to an RDS instance. Please note that RDS provides you with a DNS endpoint using which you can connect to your database instance. This DNS endpoint will not change during the lifetime of your instance. This ensures that then you do not have to reconfigure your application's database connection endpoints as long as you're using the same database instance.


Q: For RDS DB, should we enable the AWS automated backup?
A: It’s your own preference, and the Control-M embedded Backup/Restore solution are still recommended while AWS automated backup is a good supplement.


Q: For RDS DB, should we enable RDS DB Auto minor version upgrade?  Will it affect Control-M?
A: It will not affect Control-M, as long as the major RDS DB version is compatible with Control-M.


Q: Is Amazon Linux compatible with Control-M?
A: EM server and CTM/Server are not supported.  Control-M/Agent 9 Fix Pack 2 supports Amazon Linux 2015.09.x (64 bit) and later with the following prerequisites:
* ksh-20120801-19.el7.x86_64.rpm
* compat-libstdc++-33-3.2.3-61.x86_64.rpm


Q: Can we upgrade from old Control-M normal installation to V9 in AWS?
A: Yes you can.


Q: Does Control-M support Multi Subnet which is needed and widely used in AWS?
A: At moment, we don't support it. We have already a RFE to address this.


Q: Does control-M support AWS s3 file transfer protocol?
A: At this time AFT does not support working with AWS S3. It is planned to be included in future functionality of our Managed File Transfer product. It has not been announced when this will be included in a future release.


Q: Does control-M support Elastic File System (EFS)?
A: Yes, Control-M server V9 and Agent v9 support EFS


Q: If I have an on premise Control M, can we use the existing software distro after installing the Fix Packs, or do we need the cloud media? Do we need a new license for this?
A:  The existing media (DROST) can be used to install the Control-M in a non-cloud environment.  We do recommend using the "with cloud support V2" media for installing in cloud.  Fix Packs can be applied to both of these installations.  We would advise speaking with your account rep regarding any licensing or entitlement.


Q: How is the HA and DR handled for Control-m 9.0 on two distinct regions?
A: As long as the two hosts have connectivity between one another, it behaves no different than HA or DR on-prem.  With HA, there are complications if there is significant latency between the different hosts (and their databases).


Q: Is it must to have elastic IP while creating an instance or while choosing from the AWS marketplace?
A: It’s not a "must", but it is highly recommended.  If you do not have an EIP or configured VPC, the public IP of the Control-M host will change with each restart, requiring the EM (CORBA) configuration to be updated to reflect the new public IP.


Q: What considerations are there for a mixed AWS environment, where for instance, the EM is installed on the corporate network with some Control-M Servers in AWS and some on company network?
A: The main consideration in such a scenario is the networking.  You must ensure proper connectivity between any hosts on the corporate network and those running in the cloud.


Q: what is the minimum space required for the server to install correctly on AWS or was this discussed earlier?
A: The installation guide states a requirement of 100 GB for installation of Control-M on a UNIX host.  This should be sufficient for the base installation and the subsequent installation of the required Fix Packs and patches.


Q: Can an on-premises Control-M EM server manage both on-premises Control-M servers and AWS Control-M Servers at the same time?
A: Yes, it is not a problem.


Q: What’s the Control M AWS media file format? Is it downloadable?
A: The installation media is available in ISO format as well as zip for Windows and tar.Z for UNIX.


Q: Can we have v8 in on premise while installing v9 in AWS?
A: Yes, normal considerations of working with different versions of Control-M would be to be taken into account.


Q: How are the Control-M Agents connected to East Region's Control-M/Server will connect in case of DR to the Control-M/Server in the west region?
A: This will work the same as an on-prem installation.  If the Control-M/Server fails-over, when it initiates communication with the M/Agent, it will use its name and the M/Agent will update its primary M/Server to that new name.  There must be network connectivity between the M/Server and M/Agent.


Q: Can we ftp the iso image from local desktop environment to EC2?
A: Yes as long as the ftp is enabled at your AMI and allowed by your corporate network.  Typically it would be easier to scp or sftp the image, as this is enabled by default in the Linux EC2.



Q: Can primary and secondary CONTROL-M AWS instances be installed in Amazon data centers in different time zones?  Are there any specific configuration issues for this configuration?
A: The same considerations would need to be made as performing an installation on-prem.  It would generally be advisable to have an HA/DR pair configured for the same time zone to avoid confusion.

Share This:

Would you like to improve your Control-M Workflow development cycle?


Have you heard about the Automation API WorkBench?


Please join us for the next Connect with Control-M webinar on Wednesday November 29th when Ruben Villa will explain and demonstrate how to use some of the latest tools and techniques to speed up your implementation of workflows. We’ll conclude with a live Q&A session.


Register Now!! 


IMPORTANT: Each registration ID can only be used by one person. Please have all interested participants register individually.

Share This:

Technology continues to evolve and new innovations are launched every single week and Control-M is no exception! Every year we spend countless hours gathering customer feedback, improving functionality, and streamlining the user experience to help you with your digital journey. Don’t get left behind by staying on Control-M versions 7 or 8.


Here’s a look at what you’re missing if you’re not on Control-M 9. Contact us today if you have any questions about upgrading.


Control-M 7


Upgrade your Control-M environment to Control-M 9 to enjoy automated agent deployment, a new and improved user interface and promotion between environments.


Control-M 9’s automated agent deployment feature allows you to upgrade one or many agents to version 9 or install a fix pack deployment in a few simple steps. This feature also applies to the EM GUI client component and has a wizard interface to take you through the upgrade process. Upgrade quicker and with less risk, resulting in significantly reduced TCO for managing your ever-expanding workload environment.


The Control-M 9 user interface is more logical and easier to use than ever before. Whether your role is an administrator or a business user, a scheduler or developer – Control-M 9 retains and adds new features in an interface that is easy for all roles to use and master. With Control-M 9, you’ll involve everyone in the organization in the workloads that are so critical to your business.


Promoting jobs from dev to test, or test to prod across your various environments usually involves a lot of manual work like search and replace, and inconsistent operations. These methods can introduce errors at the most inopportune times.  With Workload Change Manager and the Promotion feature, manual work is replaced with promotion rules that operate the exact same way 100% of the time.  You’ll have complete control over the promotion process with consistent, fast, and error-free deployments and production will run smoother and more reliably than ever!


Control-M 8


Upgrade from Control-M V8 to Control-M 9 and enjoy automated agent deployment, a new and improved user interface, promotion (above) and Application Integrator.


Application Integrator is a web-based design tool that guides you through developing custom job types for your Control-M environment.  Relying on scripts or other brute force methods for custom applications can be costly to maintain and can leave you vulnerable to compliance issues. Application Integrator allows your application development and operations teams to work together in order to create custom job types that can be easily built and deployed, allowing you to manage all of your custom application workflows with the same power and efficiency you have with the out-of-box integrations Control-M has today. Application Integrator also give you access to a crowd-sourced community where AI created job types are available for you to use.


bmc controlm logo new.JPG

Share This:

Join our webinar to understand how to deploy Control-M 9.0.00 in the cloud using Amazon Web Services.  During this webinar, we will cover: Installation media for Cloud, Supportability, and Settings & Installation procedure.  Come learn how you can address your changing business needs by utilizing the public cloud enterprise job scheduling capability with Control-M.


Please join us for the next Connect with Control-M webinar on Wednesday October 25th when Ted Leavitt will explain and demonstrate how to deploy Control-M on AWS. We’ll conclude with a live Q&A session.


Register Now!!


IMPORTANT: Each registration ID can only be used by one person. Please have all interested participants register individually.
Share This:

Have you ever been curious about how the New Day procedure functions or maybe you would like to know more about optimizing it?


Learn how to identify problems, trouble shoot issues and improve performance in this under the hood look at the New Day procedure.


This is the link on YouTube for the recorded session:


Connect With Control-M: New Day Architecture & Troubleshooting - YouTube


Here is the Q&A for this webinar (Connect With Control-M: New Day Architecture & Troubleshooting)




Q: Is timing of pre-newday configurable? By default it happens 1 hour before newday, can we change that if we want?   

A: No, it is not possible to change it at the moment, it is working by design



Q: Where can I find the CE log?   

A: You can find CE log in $<SERVER_HOME>/ctm_server/proclog directory on Control-M Server



Q: What's the difference between the CE* log and the p_ctmce* logs?   

A: CE log contains the execution of CE process, p_ctmce is recorded in case of CE process is facing issues



Q: Which are the Control-M/Server processes that execute the New Day?   

A: The CE process is in charge of execution new day, CD internal subsystem is the one that records new day messages in ctmlog table



Q: So just to be clear, jobs with user specified user dailies are NOT included in pre-newday - correct?   

A: Correct, orders only jobs from folders with Automatic order method, this is the same as System user daily on previous Control-M versions



Q: If the server hosting the Control-M/Server crashes during New Day, should the New Day be executed again once CTM/Server is up and running?   

A: Yes, the new day will continue execution once Control-M Server is up and running again



Q: Where do we find out Control Module logs and for how many days?   

A: Control-M module logs like DB, People Soft and more are set in the agent machine in proclog directory



Q: Is it recommended to schedule jobs near to the time New Day runs?   

A: It depends on your needs, you only have to be aware that the server will track the status of the job after server processes are resumed after new day, in case job continues running during New Day,



Q: I have a quick question, for during the time New Day process executes. If Control-M server crashers, after server is up will New day process continue to run?   

A: Yes, the new day will continue execution once Control-M Server is up and running again



Q: In the NEWDAY message we do not see the message where it states PREODER JOBS copied to AJF   

A: It is normal since the pre-order process loads jobs to a temporary file, the user daily is when new jobs are ordered into active environment



Q: These commands can be done by Control-M Version 8 correct?     

A: Correct



Q: What all does the pre new day do?   

A: It cleans statistics, agent logs, and server table entries, remove old jobs and loads new jobs into active environment



Q: If you issue the clean_ajf command after newday ran would it ONLY remove old jobs or would it clean all newly loaded jobs?

A: It will remove all jobs from the environment since it truncates cms_ajf table



Q: What happens if I run 'ctmlog list 49’?   

A: It does not work the time parameter only accepts until 24 hours



Q: Could you please detail, how exactly ctmagcln works? We often see that the sysout files are not removed on some agents when investigated found that batches are defined with different names of same server which conflicts the ctmagcln process.   

A: ctmagclns basically removes logs, status and output files from every agent connected to the server, it's necessary to troubleshoot in case of any files not removed from agent



Q: We are on V8 what are the setting we need to do for PREODER to work?

A: PREORDER runs by default 1 hour before new day



Q: Are commands similar in UNIX?   

A: Yes, commands are the same as in UNIX



Q: What are the parameters related to the log and statistics cleanup value stated in the ctmlog?   

A: The parameter for updating the amount of days to keep Server logs is IOALOGLM this can be updated from configuration manager (CCM), by default we keep 20 runs per job in the statistics table, by running the ctmruninf is possible to delete those statistics outside New Day



Q: Why ended not ok jobs comes to next day, even though it’s not having maxwait?

A: By design the not ok jobs are not removed with the new day, this in order to review if is normal such jobs failed



Q: How can we check if preorder COPY is failed or successful?

A: there is no way to troubleshoot on the preorder copy, you can run ctmudchk command after new day to validate new day ordered all jobs



Q: If we have to hold some job exactly starts at the new day time, how do we go ahead for that?

A: New jobs won't run during new day, Server will start execution jobs once processes are resumed after new day finishes, it is possible to use ctmpsm utility to hold the job by command line while download is performed and WLA client is refreshed



Q: Can we forcefully run the new day process at any other time if we wanted to? If so what utility we need to use?   

A: The new day must run only once a day, however is possible to change new day time by updating DAYTIME parameter from configuration manager (CCM)



Q: What's needed to be checked if the new day is stucked or taking a lot time?

A: You can check the CE and p_ctmce* log files from proclog directory that will give a clue on why new day is stuck on execution


Filter Blog

By date:
By tag: