Skip navigation
1 2 3 4 5 Previous Next

Control-M

294 posts
Share This:

Technology is evolving faster than ever, and it redefines your clients’ expectations much faster than your organization’s ability to manage change. Change can be challenging, and change management processes are still slow. Oftentimes organizations resist change, believing that the risks outweigh the benefits.

Software upgrades are no exception. If you work as a software administrator, you know how hard it is to stay up-to-date with your products’ maintenance levels. By the time you have completed your latest product upgrade, you find that newer versions have often been released. Yet, you know how important it is to keep your workload automation solution updated.

BMC understands this challenge, and with Control-M 9.0.18, we’ve solved the problem! We’ve introduced new features that make timely (and costly) upgrades a thing of the past.

 

In this blog, I’ll share some of the new upgrade features. See my next blog in this series, “There’s No Time for Downtime – Part 2”, to read about additional upgrade features.

 

Before Control-M 9.0.18:

In large organizations, the  process to get a new Control-M version in place can take a long time. Upgrades are usually delayed for as long as possible, and when they are undertaken, regression tests, data validation, and compatibility tests are required, making the upgrade even more challenging. 

Beyond the time required for budget approval, order fulfillment, environment build and set-up, the potential risk to production is often the biggest barrier to getting approval for a Workload Automation upgrade. Downtime requires significant preparation and a communication plan because workload automation is vital to a company’s most mission-critical services. Business users are often reluctant to accept any downtime of services they rely upon.

Administrators must negotiate the upgrade time with end users by submitting a request for approval. Gaining approval means everyone has to articulate his or her personal business case for changing. The greater the downtime impact, the harder it is to get approval, and the longer it takes to negotiate the upgrade window.

 

With Control-M 9.0.18: near-zero downtime and automatic rollback

Control-M v9.0.18 now features near-zero downtime, making the planning and negotiation much easier. If an end user’s requirements or priorities require rolling back to the previous Control-M version, it can be done quickly and easily.

In addition to the near zero-downtime upgrade and simple rollback features mentioned above, the latest version of Control-M has many new features – all designed to help you consume innovation faster. I’ve detailed them in the next blog in this series, “There’s No Time for Downtime – Part 2”. We’re constantly evolving Control-M to help you  consume innovation faster and deliver on your digital transformation initiatives. Now it’s easier than ever to stay on the latest version of Control-M.

 

What customers are saying:

“Control-M v9.0.18 has shown a near-zero downtime. By minimizing the business impact on applications and end-users, it accelerates the approval for upgrade requests, and it could reduce negotiation activities in large environments by 50%-70%” - “Stefano Sensale, Senior Consultant, Beta 80 Group”.

Share This:

We all know communication between systems should be kept secure, but the process to implement security can be overwhelming.

 

Control-M 9.0.18 makes it easier than ever to secure communication between Control-M components, ensuring business critical workloads are running with the highest levels of security.

 

Join us for a live demo to see how to enable SSL encryption between Control-M clients and Control-M/Enterprise Manager Servers in under 20 minutes.

 

This webinar will cover:

 

•    New Control-M/Enterprise Manager security architecture

•    Control-M requirements for obtaining an SSL certificate

•    How to create a keystore and use it with a Control-M Web Server

•    Tips when implementing SSL

 

In this webinar Eric Epperson will explain and demonstrate the above.

 

This is the link on YouTube for the recorded session:

 

Connect With Control-M: Securing Control-M/Enterprise Manager 9.0.18 Client Connectivity - YouTube

 

Here is the Q&A for this webinar (Connect With Control-M: Securing Control-M/Enterprise Manager 9.0.18 Client Connectivity)

 

________________________________________________________________

 

Q: What does SSL stand for?

A: SSL stands for Secure Sockets Layer and is the standard security technology used for encrypting communication between a server and client

________________________________________________________________

 

Q: Why can I not use the certificates generated on CCM?

A: Because for the certificates generated on CCM, it’s not possible to edit the Common Name in order to make it match with EM’s host name.

________________________________________________________________

 

Q: Isn't the openssl tool embedded with the Control-M installation?

A: Openssl is included with Control-M

________________________________________________________________

 

Q: Does the manage_webserver utility back the old config up?

A: It does, you'll see the old file saved in the directory

________________________________________________________________

 

Q: Where can detailed information on SSL configuration be found?

A: In the Control-M SSL Guide available at docs.bmc.com

________________________________________________________________

 

Q: Can I just remove the unsecure connector and keep the secure one instead of removing both?

A: Creating the new secure connector is how the certificate information is associated with the Web Server. Removing the existing connector will insure that users are using the correct secure connection information.

________________________________________________________________

 

Q: Why is FQDN required?

A: With an FQDN there shouldn't be any issues with DNS etc, you can use a short name also however it's recommended to add it as a subject alternate name. This ultimately depends on the environment.

________________________________________________________________

 

Q: Could you please provide, which command which we need to use to start Web server

A: You can use start_web_server, we prefer to recycle Control-M Web Server from Configuration Manager when possible.

________________________________________________________________

 

Q: Do we need to upgrade our environment to 9.0.18 from 9.0.00 to achieve this?

A: You can enable SSL in version 9.0 too but process is different so please review corresponding SSL Guide according to your version.

________________________________________________________________

 

Q: Do we need to follow the migration/upgradation step to move from 9.0.00 to 9.0.18?

A: Yes, you can check Migration Guide to get familiar with the process. You can also open an AMIGO ticket to assist in reviewing your upgrade plan.

________________________________________________________________

Share This:

We all know communication between systems should be kept secure, but the process to implement security can be overwhelming.

 

Control-M 9.0.18 makes it easier than ever to secure communication between Control-M components, ensuring business critical workloads are running with the highest levels of security.

 

Join us for a live demo to see how to enable SSL encryption between Control-M clients and Control-M/Enterprise Manager Servers in under 20 minutes.

 

This webinar will cover:

 

•    New Control-M/Enterprise Manager security architecture

•    Control-M requirements for obtaining an SSL certificate

•    How to create a keystore and use it with a Control-M Web Server

•    Tips when implementing SSL

 

For the next Connect with Control-M webinar on Wednesday April 25th, Eric Epperson will explain and demonstrate the above.  We’ll conclude with a live Q&A session.

 

 

Register Now!!       

 

 

Target Audience: Administrator, Operator.

 

 

IMPORTANT: Each registration ID can only be used by one person. Please have all interested participants register individually.

Share This:

Are you migrating to Control-M 9.0.18 and want to ensure your previous version job reports work properly in the new release?

 

Learn more about the new Control-M Reports tool which replaces the previously released Reporting Facility in Control-M.  The new Reports tool contains many enhancements and capabilities.

 

This webinar will cover:

 

•    The new architecture of Control-M Reports

•    The requirements to run it successfully in your environment

•    The process to identify your current jobs that execute Reporting Facility reports

•    How to convert previous jobs to the Control-M Report format

•    How to automate Reporting tool jobs using the Control-M Automation API.

 

In this webinar Irwing Sanchez will explain and demonstrate the above.

 

This is the link on YouTube for the recorded session:

 

Connect With Control-M: Migrating Reports to Control-M 9.0.18 - YouTube

 

Here is the Q&A for this webinar (Connect With Control-M: Migrating Reports to Control-M 9.0.18)

 

________________________________________________________________

 

Q: Can we migrate reports from v8?

A: Yes the conversion tools supports V8.

________________________________________________________________

 

Q: Is it true that you need the Java Developers Kit installed to use the Automation API?

A: No, the AAPI and Automation CLI do not need Java installed.

________________________________________________________________

 

Q: Does the ctm-cli have to be installed on your client machine?

A: No it doesn't need to.

________________________________________________________________

 

Q: Do the migration utilities will migrate reporting jobs using report templates?

A: Reports are not migrated with the migration toolkit.

________________________________________________________________

 

Q: Does the analyzer utility have to be run on any EM client machine or from a centralized location?

A: On the EM Server, so a centralized location.

________________________________________________________________

 

Q: Do you run the analyzer from the EM server or client?

A: EM Server

________________________________________________________________

 

Q: Is Automation API included with EM or do we need a different license for it?

A: It is part and licensed with the Enterprise Manager Server.

________________________________________________________________

 

Q: What are the available output formats for the Reports?

A: CSV and PDF are supported.

________________________________________________________________

 

Q: Does the agent where you have Automation API have to be on the same machine where the EM server is running or where the EM client is running?

A: It does not, the Automation CLI can be installed and run from any machine that can reach the EM endpoint.

________________________________________________________________

 

Q: Is there a limit to how many characters can be in a report name?

A: 128 is maximum length and 4000 for the description.

________________________________________________________________

 

Q: When I import a report template, is it available to other users in my environment?

A: Imported reports are specific to the user that imported them.

________________________________________________________________

 

Q: The Peak usage report used to have a summary at the bottom with total jobs scheduled for the month and total executions for the month... is that still part of the report?

A: It doesn't at the moment, feel free to open a case to discuss.

________________________________________________________________

 

Q: Are there other format other than jason?

A: For the definition only JSON is supported.

________________________________________________________________

 

Q: Does 9.0.18 need any additional license?

A: Licensing does not change between versions. Licensing specific questions should be directed to your account team.

________________________________________________________________

 

Q: When importing the converted reports, can you import multiple reports at once? Or do you have to do them one-by-one?

A: I should be done one-by-one.

________________________________________________________________

 

Q: If we don't want to install the automation API as part of our 9.0.18 upgrade project is there an executable we can call to generate the reports?

A: The Automation CLI doesn't have to be installed to run reports, the Client application can be used. Alternatively rest calls can be made to the EM Server to get the report. The Automation CLI does provide a means to make rest calls from the command line.

________________________________________________________________

 

Q: Is the automated API and add-on that has to be purchased or is it included when upgrading to v9?

A: The Automation API is included with Enterprise Manager from Control-M 9.

________________________________________________________________

 

Q: Is the Automation API installed automatically with agent 9.0.18? If it isn't, can it be "deployed" via CCM, like other plugins?

A: The Automation API is part of the EM installation. The Automation CLI is separate installation that is a Node JS application. This would be installed on the Agent but there is no deployment for this.

________________________________________________________________

 

Q: Is there a reporting facility template in planning domain to create reporting jobs?

A: When running with the Automation CLI and OS type job can be used. There is no longer a dedicated job type.

________________________________________________________________

 

Q: Would you still have a "Reporting" job type that you could use to run the AAPI command?

A: Reporting jobs can now be run as an OS type job (in conjunction with the Automation CLI), also it's possible to build an Application Integrator job to build a job to make a direct REST call.

________________________________________________________________

 

Q: because of the volume of reports we have, I would prefer to upgrade WA & Control-M Server to .18 without upgrading reports.  Is it possible to continue to use Control-M reports V9 not 9.18 until we have time to transition to 9.18 reporting?

A: 9.0.18 can be run in Compatibility mode, when this is configured Clients and reporting run as Control-M 9.

________________________________________________________________

 

Q: Is there still the possibility to run/create AUDIT reports?  (Was it in the HISTORY tab)

A: Yes Audit reports can be created and run.

________________________________________________________________

 

Q: Can you access a newly created report in 9.0.18 via the following REST endpoint: https://emhost:8443/automation-api/reporting/report/{name} and what values are acceptable in the format query string?

A: Yes that the correct endpoint, you can use any means to make the rest call once authenticated. 

________________________________________________________________

 

Q: I see you can import reports into the EM, can you export them as well (to send them to other EM environments).

A: At the moment this isn't possible, feel free to open a case to discuss your needs.

________________________________________________________________

 

Q: We are currently in the process of upgrading from V8 to V9.0.500 then at some time going to 9.0.18.  Do I have to convert my current reports in v8 for the upgrade to v9.0.500?

A: The Upgrade tool should work with V8 reports.

________________________________________________________________

 

Q: Does Report Name support spaces?

A: Presently it does not support spaces.

________________________________________________________________

 

Q: Are the same output formats .csv, .xls supported?

A: CSV and PDF are supported.

________________________________________________________________

 

Q: We have not used reporting in the past so was just wondering how the reporting has changed from previous versions

A: The GUI is now web based and uses HTML 5. As such removes the need to manage database connections.

________________________________________________________________

 

Q: Are the reports stored locally on the EM? If so where?

A: They are temporarily stored within the EM webserver, the location to copy can be specified when making the rest call.

________________________________________________________________

 

Q: Does anything need to be done on the mainframe side in order to run reports from the EM.

A: Reports are run on the EM side, so there is nothing special to do with Mainframe Server installations.

________________________________________________________________

 

Q: Can version 8 reports be run in version 9 without converting?

A: Yes V8 reports can be converted.

________________________________________________________________

 

Q: What actually does the conversion utility do?

A: The conversion tool converts the old Crystal Reports templates to the new format so they can be used with Control-M 9.0.18

________________________________________________________________

 

Q: Is there any special license requirements for the new report interface?

A: No reporting is part of the Control-M EM installation and is licensed with this.

________________________________________________________________

 

Q: What about credential for connecting from CTM to the EM, need a special user and what privilege, what about the password?

A: An EM user can be created and used to run the reports. This is the account that was added with the AAPI environment option.

________________________________________________________________

 

Q: Does Control-M take care of old reports that where generated in the temp folder (D:\Program Files\BMC Software\Control-M EM 9.0.00\Default\emweb\reporting)?

A: Yes these are cleaned up according to a defined schedule.

________________________________________________________________

 

Q: Does EM Miner still work with 9.018?

A: EM Miner is not part of the Control-M release, please contact your account team for assistance with this.

________________________________________________________________

 

Q: Using AAPI, how can we pass arguments to the Report filters?

A: Report filter would be specified in the report definition. The AAPI allow the report to be retrieved.

________________________________________________________________

 

Q: How well will reports created in 7 convert over?

A: If reports can be run in Control-M 9 that can be converted. The first step will be to move them to Control-M 9.

________________________________________________________________

 

Q: Is control-M agent is mandatory to install to run the reporting host server?

A: No the reporting server is part of the EM installation, the Agent is used to create the rest call that that is used to run the report.

________________________________________________________________

 

Q: Every user that has a report defined in their client would have to go through this conversion process?

A: That's correct.

________________________________________________________________

 

Q: Are the reports stored in Temp?

A: Reports are stored on the EM webserver and cleaned up after the configured time.

________________________________________________________________

 

Q: Can the reports be written to a UNC location other than an EM server?

A: Yes provided that the user can access the location (write). 

________________________________________________________________

 

Q: Is it possible to only output the report to SYSOUT rather than a file? We use to look for specific text and email when found but not really looking to place report output in a file?

A: Reports are provided in file form, a Control-M for web services job could be used to get the file, we suggest opening a case to discuss.

________________________________________________________________

 

Q: Can version 9.0.18 be used to run reports from self-service post report conversion. I assume so as this should be no difference to a normal flow (i.e. non self-service)?

A: Yes 9.0.18 reporting can run Self-Service reports.

________________________________________________________________

Share This:

Are you migrating to Control-M 9.0.18 and want to ensure your previous version job reports work properly in the new release?

 

Learn more about the new Control-M Reports tool which replaces the previously released Reporting Facility in Control-M.  The new Reports tool contains many enhancements and capabilities.

 

This webinar will cover:

 

•    The new architecture of Control-M Reports

•    The requirements to run it successfully in your environment

•    The process to identify your current jobs that execute Reporting Facility reports

•    How to convert previous jobs to the Control-M Report format

•    How to automate Reporting tool jobs using the Control-M Automation API.

 

Please join us for the next Connect with Control-M webinar on Wednesday March 28th when Irwing Sanchez will explain and demonstrate the above.  We’ll conclude with a live Q&A session.

 

 

Register Now!!      

 

 

Target Audience: Administrator, Operator, Developer.

 

 

IMPORTANT: Each registration ID can only be used by one person. Please have all interested participants register individually.

Share This:

Do you want to visualize the status of internal and external business-to business (B2B) transfers from a central automation platform?

 

Learn how our newest product, Control-M MFT Enterprise B2B, provides a secure method for external business partners to transfer files to and from Control-M Managed File Transfer environments from an easy-to-use web interface and more.

 

In this webinar James Pendergrast will explain the architecture of this add-on and how you can get the most out of it in your organization.

 

This is the link on YouTube for the recorded session:

 

Connect With Control-M: Control-M Managed File Transfer Enterprise B2B (Version 9.0.18) - YouTube

 

Here is the Q&A for this webinar (Connect with Control-M: Control-M Managed File Transfer Enterprise B2B (Version 9.0.18))

 

Q: Is the name of the product Managed File Transfer Enterprise? Or Managed File Transfer B2B?

A: Managed File Transfer Enterprise

________________________________________________________________

 

Q: Is it licensed separately from MFT?

A: Managed File Transfer is an additional purchase on top of Managed File Transfer (MFT).

________________________________________________________________

 

Q: What version of EM is necessary to use MFT Enterprise?

A: Enterprise Manager must be 9.0.18.001

________________________________________________________________

 

Q: Are we need to shut down related agent before start installation?

A: No, it must be pushed and activated while the agent is online.

________________________________________________________________

 

Q: Will this upgrade AFT to MFT?

A: Managed File Transfer 9.0.18 can only upgrade accounts from AFT 8.2 and Managed File Transfer 9.0

________________________________________________________________

 

Q: Are MFT and MFT B2B 2 separate products?

A: Managed File Transfer is an additional purchase on top of Managed File Transfer (MFT).

________________________________________________________________

 

Q: Can we grant/limit access from Authorizations to the MFT Enterprise Settings?

A: The Managed File Transfer has authorizations that are specific to the transfers and access. Enterprise Manager has a separate set of authorizations.

________________________________________________________________

 

Q: Is Gateway machine a CTM agent?

A: No, it’s a standalone process.

________________________________________________________________

 

Q: Does the HUB install on windows platform or just Unix?

A: The Hub can be installed on Linux and MS Windows

________________________________________________________________

 

Q: At a user group meeting I heard that the Control-M MFT B2B is not included with the licensing for Control-M MFT that the B2B needs to be purchased as an add-on is that true?

A: Managed File Transfer is an additional purchase on top of Managed File Transfer (MFT).

________________________________________________________________

 

Q: Does MFT encrypts/decrypts files according to various vendor if yes then where are the keys stored or do we still need to use any pgp tool for that and also how about zipping/unzipping

A: MFT currently does not encrypt the file, this will need to be done with an external process.

________________________________________________________________

 

Q: Can we create specific folders for specific external users/partners?

A: Yes, each external user is assigned to one or more folders.

________________________________________________________________

 

Q: Can I use MFT 9.0.18 in compatibility mode?

A: No, the forms and information needed for Managed File Transfer Enterprise to work, is not available when in Compatibility Mode.

________________________________________________________________

 

Q: What kind of penetration testing has the CTM MFT B2B been through to make sure that the Gateway through to the internal is protected from hackers?

A: Please contact BMC for results from Penetration testing.

________________________________________________________________

 

Q: What happens if there is an overload of the interfaces such as a denial of service overload?

A: This will affect the availability of Managed File Transfer Enterprise.

________________________________________________________________

 

Q: Does update 001 need to be installed on both the EM Server and Clients?

A: Update 001 needs to be installed on all the EM clients that access MFT Enterprise.

________________________________________________________________

 

Q: Does the File Exchange function as a reverse-proxy?

A: Yes, it does function as a reverse proxy.

________________________________________________________________

 

Q: What protocols does Managed File Transfer Enterprise support?

A: Currently we support FTP, FTP with SSL/TLS, SFTP, and HTTP(S) but we'll include more in future. If you need a specific protocol that isn't currently supported, please open a ticket, so we can document the request. We are always looking for input for what is requested.

________________________________________________________________

 

Q: What reporting is available for file transfers?

A: You can use the reporting facility and the mftreportcli to create reports. There are 2 new reports available.

________________________________________________________________

 

Q: Are there dependencies between MFT B2B and MFT?

A: Managed File Transfer is an additional purchase on top of Managed File Transfer (MFT).

________________________________________________________________

 

Q: We only have AFT 8.2, could we use MFT B2B with AFT 8.2?

A: MFT is additional functionality on top of Managed File Transfer 9.0.18.

________________________________________________________________

 

Q: Does search of files at dashboard working also for files, that names in definition consist variables?

A: Wild cards and partial files names can be matches when searching for a file.

________________________________________________________________

 

Q: Is the webpage interface the only interface external users can use, is there any sort of cod line or other interface they could script around and automate with

A: Yes, external users can access their files via FTP over SSL, SFTP, and REST over HTTPS.

________________________________________________________________

 

Q: Will AFT work as normal, or does this replace AFT totally?

A: Managed File Transfer Enterprise replaces AFT when installed.

________________________________________________________________

 

Q: Can external users download files via B2B?

A: Yes, via FTPS, SFTP, and REST over HTTPS.

________________________________________________________________

 

Q: Can this be installed on either Windows or Linux?

A: The HUB can be run on Windows or Linux. The Gateway must be installed on Linux.

________________________________________________________________

 

Q: AFT and MFT are different license?

A: Yes, they are separate licenses. Managed File Transfer is an additional license on top of Managed File Transfer.

________________________________________________________________

 

Q: What is the timeline for those who are currently in version 9.0.00.103 to upgrade to B2B Enterprise?

A: Managed File Transfer 9.0.18 is currently available, and can be deployed once EM and Control-M/Server are version 9.0.18.

________________________________________________________________

 

Q: The notification sent when files arrive, can it contain the file name that arrived?

A: Yes, the notification contains the filename.

________________________________________________________________

 

Q: Is the hub installed on the Control-M/Server or Control-M/Agent?

A: Hub is installed on a Control-M/Agent.

________________________________________________________________

 

Q: Is MFT available for Windows?

A: Yes, but gateway only available for Linux

________________________________________________________________

 

Q: Is there a limit on the file size which can be transferred? Also does it allow to transfer multiple files at same instance (like 100 at a time)?

A: No, there is no limit coded, as long as the servers involved can handle the traffic.

________________________________________________________________

 

Q: Is it possible to set up B2B failover?

A: The HUB and Gateway can be configured to run on existing HA platforms for redundancy.

________________________________________________________________

 

Q: To exchange files with another multiple companies in a managed way, does Ctrl-M need to be installed on both ends, or just the "server" side?

A: Any client supporting FTP over SSL, SFTP or supporting REST over HTTPS can exchange files.

________________________________________________________________

 

Q: Can external users download files via B2B?

A: Yes

________________________________________________________________

 

Q: Will existing defined AFT jobs on previous versions still work seamlessly?

A: Yes, as long as the previous version of AFT was previously running 8.2.

________________________________________________________________

 

Q: Can the reports be used for the AFT transfers existing already or only for the installed B2B?

A: Yes, the repots can be customized to only show MFTE transfers.

________________________________________________________________

 

Q: Can external user use regular FTP client to upload/download without using web interface?

A: Yes, he can use ftp or sftp client.

________________________________________________________________

 

Q: Can CTRL M MFT Agent be installed on windows too? If not, when are we going to have a MFT Agent for windows?

A: Yes, Managed File Transfer supports Microsoft Windows.

________________________________________________________________

 

Q: How did Bob at ACME get the logon link and password?  Who manages the password changes?  Is this automate?

A: The administrator of MFT Enterprise created his account and sent him his credentials, and can managed SFTP key.

________________________________________________________________

 

Q: Does MFT come with 9.0.18 and you would just add on the MFT B2B?

A: Managed File Transfer is an additional purchase on top of Managed File Transfer (MFT).

________________________________________________________________

 

Q: Does the B2B gateway process run as root or installation defined user?

A: Can run as any user with proper access.

________________________________________________________________

 

Q: How is the alert management in case of failures?

A: Please contact BMC for further clarification on this question.

________________________________________________________________

 

Q: Is it possible to transfer files from REST Service API without creating file transfer job to external users using MFT web interface?

A: Yes

________________________________________________________________

 

Q: Virtual folders are on gateway machine or hub machine?

A: On hub machine. There is no information stored on gateway.

________________________________________________________________

 

Q: Can we set the dependency flag once file is pulled by B2B or pushed by Vendor?

A: Please contact BMC so we can further understand the request.

________________________________________________________________

 

Q: What user on hub machine owns the files and folders of the virtual folders?

A: These are owned by the agent user, but the FTP access is handled within the FTP server, and not OS users.

________________________________________________________________

 

Q: Can the hub communicate through a hardware load balancer to have multiple endpoints?

A: Please contact BMC so we can understand the requirements.

________________________________________________________________

 

Q: Is there a conversion utility for converting existing AFT jobs to MFT B2B?

A: The AFT must be upgraded if not already running on version 8.2.  At that point MFT 9.0.18 can be used to upgrade this installation.

________________________________________________________________

 

Q: Existing AFT jobs will be automatically displayed in MFT dashboard?

A: Yes, all transfer jobs run through the job or on a MFT job in this environment are displayed don the hub.

________________________________________________________________

 

Q: Can the MFT B2B be used to receive patches from BMC?

A: Not at this time. 

________________________________________________________________

 

Q: What is the time for connection profile? Can this be changed?

A: Please contact BMC so we can receive clarification on this question.

________________________________________________________________

 

Q: We have many files about 5 GB or 15GB file transfer. Do we know how fast file can be moved with MFT Enterprise?

A: MFT Enterprise benchmarking is available on request.

________________________________________________________________

Share This:

BMC digital IT powers 82% of the Fortune 500 companies. Our innovative software solutions enable businesses to transform into digital enterprises for the ultimate competitive advantage. Control-M is transforming digital enterprises across the globe and customers rely on Control-M every day to keep critical systems driving their business, running smoothly. Whether it be financial services, information services or banking, Control-M is changing the lives and businesses of those who use it, and is behind the scenes of happy customers all over the world.

 

Raymond James Financial manages $500B in customer assets with optimized workload automation

Raymond James, a regional investment and financial planning services provider, has become a leading international financial services firm with over $500 billion of assets under their administration. Raymond James serves nearly 2.7 million client accounts in more than 2,600 locations worldwide. Over the past 10 years they have grown exceptionally and the emergence of digital and mobile technologies have increased the importance of their IT organization getting things done faster. Control-M manages RJF’s nearly 2 million monthly jobs across hundreds of applications that access the company’s data warehouse and consolidated data store. Nightly processing ensures that senior management and their 6,500+ financial advisors have the data they need each day to help clients with investment decisions. Control-M is their primary tool to identify, escalate and remediate issues that might delay their batch processing. Simplified monitoring, self-service, and predictive analytics has helped their IT organization absorb a 42% increase in monthly job executions over the past year and Raymond James audit prep now only takes a couple of hours where it previously took two to three weeks. “With Control-M, we can look at applications across the enterprise, identify recurring issues and inefficiencies, and work with people across the organization to figure out how to make things better.” – Chris Haynes, Manager of Workload Engineering, Raymond James Financial

View the Raymond James Customer story video here.

 

RailInc leverages big data and automation to help keep 1.6MM railcars rolling across 140K miles of track

RailInc, an industry leader for railroad IT and data services headquartered in Cary, North Carolina, supports railroads and their customers with essential information to improve safety and optimize rail operations. RailInc has implemented Hadoop for storing, processing, and analyzing data captured from disparate sources. Control-M supports programs like Railinc’s Asset Health Strategic Initiative, which develops tools that enable customers to track equipment usage, identify equipment issues for timely repairs, and safely and efficiently coordinate the movement of millions of railcars. Control-M automates the processes that support analysis of data of 1.6 million railcars across North America. RailInc processes 11 million data points daily and they are expecting to double their growth in data volume from 50 to 100TB in the next three years with the help of Control-M. "The order in which we bring in data and integrate it is key. If we had to orchestrate the interdependencies without a tool like Control-M, we would have to do a lot of custom work, a lot of managing. Control-M makes sure that the applications have all the data they need." - Robert Redd, Release Engineer, RailInc

View the RailInc customer story blog by Robert Redd here.

 

Itaú Unibanco transforms banking with new digital services

Itaú, the 10th largest bank in the world, and the largest financial conglomerate in the Southern Hemisphere has over 94,000 employees, 4,000 branches and 46,000 ATMs that serve a global customer base. Over the last decade, significant advances in mobile technologies have led to increased consumer demand for new digital-first banking services. Control-M is the bank’s primary digital business automation platform, processing over 14 million jobs per month and automating diverse batch application workloads for transactions in retail locations, through ATMs, online and on mobile devices. Itaú Unibanco is leading the industry with the new client-centric banking services it’s rolling out. The bank now opens almost 10% of its new accounts directly through its mobile application. “Control-M is a very important tool that we have. If Control-M stops, the bank stops.” - Leandro Araujo, Head of Production and IT Services, Itaú Unibanco

View the Itaú Unibanco customer story video here.

Share This:

Do you want to visualize the status of internal and external business-to business (B2B) transfers from a central automation platform?

 

Learn how our newest product, Control-M MFT Enterprise B2B, provides a secure method for external business partners to transfer files to and from Control-M Managed File Transfer environments from an easy-to-use web interface and more.

 

Please join us for the next Connect with Control-M webinar on Wednesday March 7th when James Pendergrast will explain the architecture of this add-on and how you can get the most out of it in your organization.  We’ll conclude with a live Q&A session.

 

Register Now!!     

 

 

Target Audience: Administrator, Operator.

 

 

IMPORTANT: Each registration ID can only be used by one person. Please have all interested participants register individually.

Share This:

Using cloud technologies can be a daunting task, especially with the ocean of choice that is now available to the modern enterprise. One thing that can be leveraged from the multitude of cloud providers is the ability to create Big Data clusters with Hadoop for processing information in the cloud, but without spending the large sums of time and effort required to house the clusters of servers on-premise. More importantly, the clusters don't need to be running 24/7 either, and effectively only need to be spun up on-demand for when processing is to occur. This is something that Control-M can handle easily.

 

The AWS Use Case

 

AWS offers several services for using Big Data and for data processing in general, but one service stands out, which is called Elastic Map Reduce. With EMR, users can spin up clusters of any size with Hadoop and various other tools pre-installed. Furthermore, users can not only make use of the AWS CLI toolset to perform actions in the cloud, but more importantly can tie the calls to AWS into the jobs they run in Control-M, either as an embedded script, command, or script file. This allows for total flexibility when using AWS. Control-M also has native integration to AWS, using the Cloud Control Module, whereby a Control-M Agent can interact with any AWS account, and perform actions on EC2 instances that are running, or launch new ones from templates, as examples.

 

Big Deal

 

So, what does this mean for data scientists and business intelligence professionals working to leverage the power of Big Data in the cloud? Well, using an enterprise-grade scheduling solution such as Control-M, users can now employ services in AWS in a streamlined manner, and use the output of what AWS provides to take dynamic action inside of Control-M. EMR is a powerful tool that, if properly leveraged, can result in delivering real valued results quickly, all while minimizing costs. The benefit is that the clusters only need to exist for as long as the processing needs to occur, and can then be eliminated, thus the notion of "ephemeral clusters". By processing what is needed, but only keeping the results, users effectively circumvent the need to keep these machines running 24/7, and still derive value for their company. These flows can also be triggered dynamically, as they are now service-oriented, instead of being regularly scheduled flows.

 

Example

 

What if every day a series of files are received, and need to be treated, but these files are massive? Do you have the steps already built into your schedules to treat them? Do you want to start leveraging AWS? With some modifications, the existing flows that make the calls to perhaps a local Hadoop cluster could be made in the cloud instead, as Control-M has the ability to run anywhere, be it on-premise, off-premise, or multi-cloud, depending on the need. You could not only treat the files as needed with a file watcher automatically, but could also trigger manually whenever you'd like to refresh data in reporting tables, or generate information at a point in time. With Control-M managing these steps, you have much more power at your disposal when invoking AWS.

 

But don't just take my word for it...

 

Using Control-M, we can invoke the AWS services necessary, in the right order, so that data is received, a cluster is instantiated dynamically, attached to Control-M dynamically, data is processed, results are sent out, the cluster is de-instantiated, information is streamed to a dashboard, all done dynamically by ordering a service from a smart phone, monitored by our Batch Impact Manager to ensure the service does not run overtime to meet SLAs. Technologies at play here include the Hadoop Control Module for Control-M, our Automation API for dynamic agent provisioning and deployment, our Managed File Transfer Control Module to handle files in and out, our Batch Impact Manager job type to manage SLAs, the innate ability of Control-M to pass variables between jobs and share information, our Self-Service Portal as well as Control-M for Mobile Devices for use by business stakeholders.

 

Taming AWS

 

We start by ensuring that Control-M has access to the AWS CLI in order to make calls to the AWS account where we're triggering cluster builds and machine instantiation. By invoking the "aws emr create-cluster" command, we can set up a custom cluster with all the bells and whistles that we'd hope for. This will ready a cluster, but while we wait we'll want to invoke "aws emr wait cluster-running" until the cluster is up and running to proceed to the next portion. The AWS CLI is extremely comprehensive, you can trigger almost anything in AWS using it, and can also craft a custom Application Integrator job that can do the specific things you need to do, effectively wrapping the calls and abstracting the runtime into the Control-M WLA or Web client.

 

File Transfers

 

You might want to pipe some files in from outside of your AWS installation, and so MFT jobs would be ideal here. You can leverage FTP, FTPS, and sFTP transfers to bring files in from partners, or from other systems in your multi-cloud environment. These files can be ultimately piped into AWS S3 or HDFS. What’s great with the Control-M MFT module is that you can create jobs that will create dependencies for your successor jobs that are based on files being successfully delivered for ingestion. Here I set up a simple transfer from Azure, since that’s where one of our partners keep their data, and bring it into our server to be ultimately pushed into S3. Hadoop’s CM can actually reference S3 bucket files and pull them into HDFS for processing.

 

Big Data Workflows

 

Control-M’s Hadoop CM can install itself on the leader node of Hadoop clusters and control the flow of HDFS, Yarn, Hive, Sqoop, and most other common binaries found in the Big Data world. With tracking for these kinds of executions, and then the passing of information between jobs and workloads, you can effectively take a platform-agnostic stance when integrating your various disparate platforms together to achieve the results you’re looking for. In this case, we’re just executing some HDFS directory creation commands, some HDFS movement commands, pulling data in from an S3 bucket, and are all pulled into HIVE tables, where I run some very simple analysis. The results are emailed back to me, and the cluster is wiped away.

 

Provisioning

 

Agents can be deployed an un-deployed as needed with Control-M, which makes this kind of ephemeral instantiation a reality. Services like these make Control-M an ideal solution to remain flexible in a world where infrastructure is as malleable as putty, and only running servers for as long as they’re needed is a reality, such as with containers. The Hadoop control module for Control-M is the only CM we make that needs to actually be installed physically on one of the application servers, in this case the leader node of the Hadoop cluster. With the Automation API, all we do is call the necessary commands to go out and pull the packages to the server for provisioning, bringing the agent bundled along with the CM as well, and it can all be detached and removed when done.

 

controlm - Control-M Workload Automation.jpg  controlm - Control-M Workload Automation (2).jpg

ctm @ controlm homectmscripts.jpg

 

Streaming

 

With the support of streaming functions, you can get the information you’ve built to the dashboards that need it, all as part of the workflows that have been built. This is ideal for visibility, and can force the refresh of information after every run, which can show you real-time information about the data you are collecting, and gain insight into trends that could create a competitive advantage. You can pipe this kind of stuff to dynamic dashboards that can show data loads, throughput, areas of interest, you name it. Perhaps you’re running an ELK stack, and are piping information out to it so that it then takes it and performs trend analysis for you.

 

Self-Service

 

All of this can be triggered by business stakeholders if needed, as services, leading to the workflows running on-demand, and refreshing data as needed. Real-time insight that can be called on-demand is a powerful concept, but is a reality when using Control-M to manage these kinds of flows. As mentioned before, you’re on the train coming to work in the morning, you see an email come in noting that the last file transfer you were waiting for overnight has completed, you make sure you’re on VPN with your iPhone or Android device, you connect to Control-M via our mobile app, and you order in your EMR flow in transit so that when you arrive in the office and sit down for your coffee, your jobs are done and the results are delivered.

 

Control-M Self-Service - Google Chrome.jpg

 

SLA Management

 

Take the services that were declared, and were made usable for business stakeholders and tie SLAs to them, so that not only can you have Control-M trend the runtime of the services of these workloads to report on slowdowns, you can also catch problems before they occur. Control-M has these features built in, allowing for long-term analysis of the workloads that stretch past Big Data and out to the rest of the enterprise as well. What's great is that the batch impact manager, while already able to take dynamic action based on a service runtime, will automatically create a service for you when ordered in. This is key, you want to make sure that when you order your flows in, that you’re not starting to creep in terms of delivery time, BIM will track this kind of thing for you.

Control-M Self-Service - Google Chrome (2).jpg

To Wrap Up

 

Since Control-M can be tailored to any situation, invoking AWS to achieve ephemeral clustering is a reality, and one which we are seeing more and more customers take advantage of. The possibility of running only what you need is a major advantage over classic always-on paradigm of hosting data lakes. Control-M with its massive flexibility and toolsets that allow for dynamic integration is an ideal choice for managing any automation that occurs in the cloud.

 

I always like to say that the triggering of the job or the action itself is only a tiny part of what makes up Control-M. The rest of the “bread and butter” of Control-M is what really seals the deal, the on-do actions, the condition passing, the alerting, the SLA management, the ability to play between hosts, the archiving and auditability, everything else that is brought to the table. Being a 3rd party arbiter of enterprise workloads is a powerful thing, I suggest you bring some of that power over to the public cloud and start trying it out!

Share This:

ControlM_Twitter .png

It’s that time again. As VP of Operations you’ve just been handed a change management request form for hardware/software maintenance. This time it relates to a workload automation upgrade. On the form, the checkbox for “critical services interruption” is selected, and the “expected downtime” assessment value is high enough to potentially affect operational efficiency. And to top it off, the budget requirement doesn’t quite fit in with the latest cutbacks handed down through organization. For all these reasons (and the fact that upgrades like this require a lot staff time), you know you’ve got to do some research before giving approval. While inspecting the upgrade process history, you find that past workload automation upgrades were painful, to say the least, and resulted in unplanned downtime of critical applications.

So, how do you ensure this upgrade will go smoothly? What must be done to avoid critical interruptions that may adversely affect your KPIs and budget? If you struggle with these questions every time you need to upgrade your workload automation solution, here’s one more reason you should switch to Control-M!

Control-M 9.0.18, the latest version of BMC’s Digital Business Automation solution, features near-zero downtime in-place upgrades. Forget about the tedious, expensive and risky upgrade process you’re used to. You can upgrade Control-M and access all the latest features in minutes.

 

How does it work?

Here’s how Control-M 9.0.18 simplifies the upgrade process:

First, it reduces the upgraded downtime to almost zero. That helps you maintain business continuity and maximize service availability. It also accelerates the upgrade approval process. In beta, customers reported that negotiation activities for the proper upgrade window could be reduced by 50-70%.

Second, it reduces the time and cost of the upgrade. The new in-place upgrade method eliminates the need for parallel environments. You can now safely upgrade in the same environment you are working on, gradually moving up components. This maintains backward compatibility with the rest of the solution. By eliminating the need for a parallel environment and data migration, you will realize significant cost and time savings. This is especially true in large environments where new IPs are required and the opening of firewalls for large numbers of agents become particularly time consuming. Customers in our beta program with large data centers reported that FTE and other resource savings during the upgrade preparation phase could reach 70-90%.

Beyond simplifying and shortening the negotiation and preparation phases, Control-M 9.0.18 reduces risk during upgrade execution. If you experience issues at any time during the upgrade, the environment can be easily rolled back to the previous version until the issue is resolved.

 

Deploy innovation faster

Starting with Control-M 9.0.18, BMC will begin releasing major updates annually, with fix packs in between. Not only will this will help customers better plan their upgrade activities, it also showcases our commitment to investing in continuous innovation. We’re already hearing from customers that the new annual delivery model will change their upgrade strategy. Today, market dynamics are changing faster than ever! Having access to a regularly scheduled stream of innovation that is quick and easy to consume through in-place upgrades, is fundamental competitive advantage that will help IT organizations achieve true digital business automation”

Click here to learn more about how Control-M can help you deploy innovation faster.

Share This:

Learn more about the Control-M/Agent directories structure and some utilities which can help you solve issues faster and get your jobs back to running again.

 

As a Control-M Administrator it's very useful to know where to start looking when you have a Control-M/Agent issue. This webinar will help you understand where to look and which utilities you can use. 

 

Please join us for the next Connect with Control-M webinar on Wednesday January 31st when Corey Low will explain the Control-M/Agent directories and utilities usage for troubleshooting and solving issues.  Corey will also demonstrate ways to debug the Control-M/Agent and which information to provide to BMC Support when having a problem. Finally, we’ll conclude with a live Q&A session.

 

Register Now!!    

 

IMPORTANT: Each registration ID can only be used by one person. Please have all interested participants register individually.

Share This:

There’s been a lot of talk about General Data Protection Regulation, but I thought it would help to provide you with some facts.

 

Picture1.png

Here’s 250 pages of GDPR information condensed into 10 bullets:

  1. Don’t have a Personally Identifiable Information (PII) data breach!
  2. Notify a legal entity of real or potential breaches within 72 hours.
  3. Remove all personal data when requested by the EU citizen within 30 days.
  4. When requested by EU citizen, within 30 days, provide all personal data and how it was used
  5. Relate the collection and processing of personal data to specific purposes.
  6. Positively verify that someone is of legal age to sign up for the service.
  7. Know where all data resides (keep records of everything).
  8. Design all systems with an appropriate and demonstrable security and process.
  9. Expand privacy accountability and liability to all partners in the ecosystem.
  10. Penalties can be up to 4% of global turnover or €20,000,000 (whichever is higher).

 

It’s no longer about just ‘not having a data breach’, it’s also about what the business is expected to do after a breach occurs.

 

So before I start, let’s clear one thing off the table, which is the question we often get, is Control-M GDPR compliant?

In short, there’s no such thing as an officially certified GDPR vendor. No vendor can be GDPR compliant, only companies can accomplish GDPR compliance through their actions and processes.

 

The right question is “Does Control-M allow your organization to fulfill the GDPR requirements?”

  • An enterprise is the data controller, and when it implements a software package, the enterprise still has to comply with GDPR.
  • The liability of the data processor (Control-M is a data processor!) – meaning the one who processes the data, or is ordered by the data controllers – is now broader than before.
  • The question, when choosing software, is whether it supports the GDPR requirements - from the privacy-by-design principles to the concrete requirements of handling consent per purpose.

 

Now let’s talk about the interesting stuff – how can Control-M help an enterprise establish the right process to meet GDPR rules.

1. Automate the Right to be Forgotten, Right to Access, Data Portability and Notify processes across all parts of the infrastructure

• Reduce cost of performing process, reduce human error, reduce time

• Integrate into the Service Request ticketing system

 

2. Control-M Alerts and Notifications

• Report Data breach within an enforced SLA

• Notify if there has been any problem when a job related with customer data

 

3. Control-M Archiving provides the process evidence to auditors in easy to understand view

• Keeps a record of what and when was executed and also who took any actions (order, cancel, modify, etc.) on them

• Contributes towards Privacy by Design

 

4. Automate the audit / compliance reporting process

• Reduce cost of audit process

• Use Self Service and Mobile interfaces to reduce time to respond to audit

 

5. Use Control-M Managed File Transfer for highly secured and controlled file transfers

• Securely manage file transfers destinations

• Track any file transfer

• Audit the troubleshoot file transfers between the organizations and 3rd parties.

 

6. Provide data lineage by tracking and evidencing data lineage of all activities, into a data lineage platform (e.g. Into Hadoop or into Splunk, or whichever you have)

• Meets compliance requirement to know where customer data is and is not used. Reduced cost of complying, especially for customers already using Control-M

 

7. Integration into Service Request and Change Management tools (for tracking, approval, handle problems, etc.)

 

GDPR is all about the workflow:

“Ensure ongoing confidentiality, integrity, availability, and resilience of customers’ personal data”

 

For more info, please visit the BMC GDPR web page

Share This:

Would you like to improve your Control-M Workflow development cycle?

 

Have you heard about the Automation API WorkBench?

 

In this webinar Ruben Villa will explain and demonstrate how to use some of the latest tools and techniques to speed up your implementation of workflows.

 

This is the link on YouTube for the recorded session:

 

Connect with Control-M: Control-M Automation API: Advanced - YouTube

 

Here is the Q&A for this webinar (Connect with Control-M: Control-M Automation API: Advanced)

 

________________________________________________________________

 

Q: Do I need a separate Control-M license for Automation API?

A: No, Automation API is installed with Control-M/Enterprise Manager 9.0.00.200

________________________________________________________________

 

Q: What types of jobs am I able to run using Workbench?

A: The type of jobs are the same available on the last version of Automation API: Hadoop, Manage File transfer, command, etc.

________________________________________________________________

 

Q: What form is the workbench machine in?

A: It can be Windows or UNIX

________________________________________________________________

 

Q: Also, is it intended to run the workbench locally or on a remote hypervisor?

A: The Workbench runs on a Virtual Box, it can be installed locally or in a remote host

________________________________________________________________

 

Q: What level of access is required for building jobs from the JSON?  I see "emuser", which implies administrator.  Can Update users do the same or is special access required?

A: API uses ctmcli and needs to get 2 tokens for login.  One from the GUI Server (GSR) and a second from the Control-M Configuration Server (CMS). 

Because of this it needs login privileges for both as defined in the CCM under Authorizations for the user that is attempting to login.  Specifically in Privileges for "Control-M Configuration Manager" and "Control-M Workload Automation, Utilities........"

________________________________________________________________

 

Q: Where can I get the workbench?

A: Downloads and Installation info are in:

https://docs.bmc.com/docs/display/public/workloadautomation/Control-M+Automation+API+-+Installation#Control-MAutomationAPI-Installation-workbenchControl-MWorkbench

________________________________________________________________

 

Q: In the demo, are the jobs created in the AJF only? Can you save the job definition instead of creating a job?

A:  Yes, with the Deploy Service, once a job is deployed, it will be scheduled by Control-M according to its scheduling criteria and dependencies.

________________________________________________________________

 

Q: How does Workbench Submission affect Task Counts?  If the DevOps is ordering jobs directly into the environment, won't this increase my task count?

A:  No, as the Workbench is a Virtual Environment.

________________________________________________________________

 

Q: How can Automation API be used to deploy jobs to environments, not just for testing?

A:  You can have multiple environments (connections) and after testing your flows, you can submit the requests to a production environment.

________________________________________________________________

 

Q: Can I use automation API for Informatica jobs?

A:  Informatica Job Type is not available at this moment.

________________________________________________________________

 

Q: Is automation API available in Control-M Version 8?

A: No, Available from Control-M/Enterprise Manager 9.0.00.200

________________________________________________________________

 

Q: Can empass be encrypted instead of clear text?

A: The encryption can be done at the application level.

________________________________________________________________

 

Q: Does job actually run in workbench?

A: No, this is just a simulation.

________________________________________________________________

Share This:

Do you need to move your existing Control-M environment to a new machine?

 

Would you like to automate and accelerate the procedure to keep your business running in the DR environment?

 

Please join us for the next Connect with Control-M webinar on Wednesday January 3rd when Andrea Carmelli will explain the process and demonstrate how to speed up the procedure to restore the hostname and configuration data in the database during disaster recovery when moving to the stand-by environment or replacing the local hostname. We’ll conclude with a live Q&A session.

 

Register Now!!  

 

IMPORTANT: Each registration ID can only be used by one person. Please have all interested participants register individually.

Share This:

Can you believe the New Year is just around the corner? What a year it has been! With one month left in 2017, be sure to join us at one of the events below or start off the New Year with Control-M.

 

We are excited to offer so many Control-M Seminars in many countries around the world. Spend the day with us to learn how your IT Ops, Developers, and DevOps Engineers can deliver applications and new services with the agility your enterprise demands—to drive successful outcomes for your digital business.

 

Explore the latest Control-M features to:

  • Accelerate delivery of services to the business
  • Quickly respond to changes and adopt new technologies
  • Accelerate application development with jobs-as-code
  • Embrace new technologies without compromising existing infrastructure

 

 

DateEventLocationVenue
December 4-6, 2017Gartner Applications Strategies SummitLas VegasCaesars Palace
December 4-7, 2017Gartner Data CenterLas VegasThe Venetian
January, 2018Control-M SeminarCentennial, COTopgolf
January 18-19, 2018DevOps DaysNYCMicrosoft Technology Center
January 19, 2018Control-M SeminarHong KongRegistration link coming soon
January 23, 2018Control-M SeminarAmsterdamMereveld
February 1, 2018Control-M SeminarMadridRegistration link coming soon
February 19-23, 2018Control-M SeminarAustraliaRegistration link coming soon
February 20, 2018Control-M SeminarMunichRegistration link coming soon
February 22, 2018Control-M SeminarHamburgRegistration link coming soon

 

*The Topgolf event has been postponed to January, 2018. More details coming soon.

Filter Blog

By date:
By tag: