Multi-platform application deployment with UrbanCode Deploy

Include z/OS in your deployment automation

Learn how to use IBM UrbanCode Deploy to manage the deployment of a z/OS operating system as part of a multi-platform application. This article includes two scenarios of how to use UrbanCode Deploy to help deploy z/OS applications: how to deploy directly using the z/OS agent, and how to integrate with the existing deployment process.

Share:

Rosalind Radcliffe (rradclif@us.ibm.com), Distinguished Engineer, Enterprise Modernization Architect, IBM

Author photoRosalind Radcliffe is a Distinguished Engineer within IBM Rational Enterprise Modernization organization. She is an Enterprise Modernization Architect responsible for driving the DevOps for System z and Power architecture and the architecture for the collaborative management capability for enterprise solutions. This responsibility includes UrbanCode Deploy and Rational Team Concert support for standard mainframe development activities. Prior to Rational, she was in Tivoli responsible for the Service Oriented Architecture management strategy for IBM.



Zhang Hong Chen (chenzhh@cn.ibm.com), Enterprise Modernization Solution Architect, IBM

author photoTony (Chen Zhang Hong) is a Senior Software Engineer within the IBM Rational development organization. He is the architect of continuous integration for System z solution. The solution enables mainframe development organizations to apply DevOps practices by using Rational Team Concert, Rational Quality Manager, Rational Developer for System z, Rational Test Workbench, IBM Rational Development and Test Environment for System z and IBM UrbanCode Deploy.



18 February 2014

Also available in Chinese

Introduction

DevOps is a set of principles and practices designed to help development, test, and operations teams work together to deploy code more frequently and to ensure a more effective feedback loop. The practices include iterative development, deployment automation, test automation, release coordination, monitoring and optimization, and many more. This article describes the factors to consider as you build a deployment automation solution for an enterprise that has applications that run on multiple platforms, including the mainframe.


Manage the deployment of multi-platform applications

Although DevOps principles apply across all platforms, the shared nature of the IBM z/OS environment has shaped, and sometimes constrained, the deployment process. In the current z/OS environment, deployment is generally automated consistently across all environments. However, this capability cannot extend to other platforms because the tools are specific to the z/OS platform. In the z/OS environment, the tools that manage source code also provide the build and deployment capabilities. Because these tools have been in place for many years, they have been significantly customized.

In the current multi-platform environment, composite applications drive the need to coordinate the deployment of the entire application across various platforms. The deployment capability in place for the z/OS environment does not coordinate well with other environments. A comprehensive and automated deployment solution is not available.

At the heart of a multi-platform application deployment system, you might expect to see a consolidated inventory view, which shows you the application with all its components and subsystems, mapped to the deployment environment. The inventory lists where each logical component is and where it should be, as shown in Figure 1 in IBM® UrbanCode® Deploy.

Figure 1.A sample inventory view from UrbanCode Deploy
UrbanCode Deploy inventory screen capture

Manage the environment

A software project typically has a set of deployment environments such as development, quality assurance (QA), and production. An environment is a collection of resources as a deployment target, as shown in Figure 2. A resource can be a physical server, a logical partition (LPAR), a virtual machine, or a subset of a cloud. It can also be a logical deployment target, such as an IBM® CICS® region, a database, or an application server platform. The deployment system needs to understand and be able to model the environment before it can create and maintain an inventory of application versions mapped to environments. In the distributed platforms, most IT organizations use application-specific environments, but multi-tenant servers can be the targets of multiple applications. The mainframe environment is typically highly shared. Approvals and team processes are typically scoped to environments.

Figure 2. UrbanCode Deploy sample environment
Environment screen capture from UrbanCode Deploy

Design the deployment processes

Deployment of applications generally consists of many steps across a large set of varying technologies. Some middleware products, such as IBM CICS and IBM® WebSphere® Application Server provide deployment tools of their own. However, these technologies are specific to the middleware and do not span multiple middleware environments. In the past, teams have developed scripts to deploy applications into production for the distributed environment. In many cases, these scripts pull the binaries from the build system to feed the deployment activities. In the z/OS environment, deployment has been handled by the source control systems. Most organizations have only a deployment checklist with many manual steps and with no automated coordination between platforms or environments.

"Automate everything" is one of the DevOps principles. For deployment the goal is to automate the process so that each deployment is done the same way. The process is coded and version controlled so that the deployment engineer or administrator defines it only one time. The process can be run whenever a deployment is required by anyone who is authorized to deploy into that environment. By having one way to deploy to all stages of development, any deployment-related problems are identified early in the development cycle.

One option is to add version control to existing scripts and require that they be used at each stage of development. Although this option is an improvement, scripts can be difficult to maintain. It is hard to clearly see the process, because it is hidden in the code.

The ability to define templates for each process and use those templates for any deployment of that type helps ensure consistency across the environments. This method is easier to maintain, long term. A graphical process designer can help to visualize the process and make it easier to understand and maintain.


Manage the versions

Frequent deployments require the deployment capability to manage versions across the system, including the deployed version of the software, the environment (sometimes software-defined), and the deployment process. To roll back to the previous stable version, you need the same environment and deployment process of that version, and you also need the software binary code.

For multi-platform applications, the deployment picture can be even more complex. Depending on the change, you might have to deploy all the parts together or you might have to roll back all the parts together. The deployment system needs to be able to tag or take a snapshot of a release version for multiple components and for all the artifacts involved in the deployment of a release.


Manage traceability

Traceability is key for effective application deployment. Organizations need to be able to trace what is being deployed back to the original requirement for that change. When there is a problem in production or during test, traceability makes it easier to understand what changes are going in that could have caused the problem. The deployable artifact needs to be linked to the build that created it, the requirement that it was implemented for, and the tests that were run to validate the function.


Incremental versus full deployment

One approach to deployment is to deploy the entire component each time, for example the application WAR file or JAR file. The other approach is to deploy only the specific changes. In the z/OS environment, organizations typically build only the changes to the application and deploy them into the environment. It is common to find that some parts of an application have not been rebuilt in over 20 years. In distributed environments, typically the complete application is rebuilt and deployed. Some reasons for the difference include the differences in language and size of the applications, the capability of the available tools, and the risk factors associated with change. Teams are hesitant to change what is working.

These deployment methodologies are not always followed. Some organizations rebuild their entire z/OS applications on a periodic basis. Some organizations deploy only the changes to their distributed applications.

Both methodologies exist and must be supported by the deployment capability.


z/OS deployment scenarios with UrbanCode Deploy

UrbanCode Deploy, formerly called uDeploy®, was developed to address the challenges of modern application deployments. Users model the structure of a multi-tiered and multi-platform application and orchestrate the processes required to deploy it. Environment-specific configuration provides the ability to create approvals and consistently promote the application through multiple environments as the application is developed. An easy-to-use graphical interface aids users as they design processes (such as the installation, uninstallation, and rollback processes) using drag-and-drop integration steps. The interface makes it easier to run deployments and monitor environment inventories. UrbanCode Deploy V6.0.1 includes z/OS support. This article describes two UrbanCode Deploy z/OS deployment scenarios:

Figure 3 shows a fairly standard enterprise application topology. The z/OS components (dark blue) run on CICS with virtual storage access method (VSAM) for the data source. Some of the web and mobile components (light blue) also run on z/OS using an application platform such as IBM® WebSphere® for z/OS. Some components (yellow) run on distributed platforms.

Figure 3. Sample enterprise application topology
Architecture: components, UrbanCode Deploy agents

The deployment of this entire application can be modeled and managed with UrbanCode Deploy. The UrbanCode Deploy z/OS agent can run deployment activities directly, or interact with an existing deployment tool, usually the SCM/Build system, to deploy.


Deploy directly using the z/OS agent

The UrbanCode Deploy z/OS agent is a process running on z/OS, which can perform a wide range of deployment activities such as performing file operations, deploying to application servers, running shell scripts including REXX (and many more), and downloading binary from one of the many build systems that integrate with UrbanCode Deploy.

To start, define the application, the components, and the environment, and create the mapping of application to environment. Figure 4 shows the JKE sample application. A DEV environment is defined for the application. At this time the application contains a single component called JKE Mobile Component and it has already been deployed to the DEV environment.

Figure 4. Model the application component and the environment in UrbanCode Deploy
JKE sample app in UrbanCode Deploy

Figure 5 shows the DEV environment, its resources, and how the components are mapped in UrbanCode Deploy. ZOS84 is a deployment resource, which is a z/OS LPAR with the agent running on it. The JKE Mobile Component is added to this resource. The mapping tells the system that when this component is deployed to DEV, it is going to be deployed to ZOS84.

Figure 5. Environment view of the JKE sample application
Application tab shows JKE Mobile Component

Use the graphical process designer to create a deployment process for the component, as shown in Figure 6.

Figure 6. Sample process to deploy a web application
Process diagram screen capture

In this example, the process performs the following activities:

  1. Downloads the deployable binary, which is a web archive (WAR) file from the repository. The build system is already integrated with UrbanCode Deploy. A new build, when available, is pushed to the repository.
  2. Unzips the WAR file into a temporary directory.
  3. Updates the web service configuration. The web application being deployed calls a back-end web service provided by CICS. The endpoint of the service is written in a web services description file (.wsdl) in the archive. This step is to replace the endpoint with the actual value of the target environment.
  4. Repeats Step 3 to replace the endpoint of another web service.
  5. Zips the content back to a WAR file.
  6. Stops the running web application in the application server.
  7. Undeploys the old version of the application.
  8. Deploys the new version of the application.
  9. Starts the updated application.

Each of the blocks is a plug-in step, or a reusable deploy task that you can drag and drop to your process and customize for your use by setting the appropriate properties. Figure 7 shows the properties of the unzip step in this process. This step unzips the MortgageMobileWeb.war file into the web folder under the current working directory.

Figure 7. Properties of the unzip step
Properties include files, names, directories

In addition to a set of core plug-ins for common deployment activities, UrbanCode Deploy comes with many integrations for source control, issue tracking, testing, static analysis, and so on. The UrbanCode Deploy plug-in system gives you the ability to add your own plug-ins.

Unless your process has platform-specific steps, such as a step to run a REXX script, the process is cross-platform. For example, you can run the process shown in Figure 7 on any platform. Different environments can be on different platforms if required. The development environment might be running on Linux® and the production environment might be on Linux for IBM® System z® or z/OS in the above example. This arrangement makes it easier to change a platform when needed.

The next step is to create an application deployment process as shown in Figure 8 to assemble the component processes. The process is quite simple because there is only one component to deploy.

Figure 8. Application deployment process
Process deploys mobile and JKE mobile component

The next step is to start the process and watch the progress. The timeline as shown in Figure 9 gives a visualized way to see the time distribution of each step. You can download the output log and error log of each step by using the icons beside the step.

Figure 9. Process execution status
Timeline shows times for each process

Integrate with the existing z/OS deployment process

Most of the z/OS source code control tools provide deployment and promotion capabilities. Many organizations running on mainframes have a deployment process based on such tools. For these teams, the use of UrbanCode Deploy to integrate their existing systems is a low-risk solution to connect the platform locked-in deployment process to the rest of the environment and benefit from at least the combined tracking and coordination.

IBM® Rational Team Concert™ Enterprise Extensions provides source control, build, promotion, packaging, and deployment. This article shows how to use Rational Team Concert Enterprise Extensions and UrbanCode Deploy to deploy a z/OS application, using the same CICS and data components in Figure 3 as an example.

For this example, the package definitions are defined in Rational Team Concert. These definitions create archives of the data sets to be deployed. Corresponding deployment definitions deploy the data sets and run JCLs and REXX to complete the deployment, as shown in Figure 10. These are the processes to be integrated to UrbanCode Deploy.

Figure 10. Rational Team Concert package and deployment definitions
Deployment deploy.mortgage.cics.test highlighted

The first step is to define the application model with two more components in the application, the CICS component and the data component, as shown in Figure 11.

Figure 11. Application model with two additional components
Application model with two additional components

When you define a component, decide what artifacts to store in the UrbanCode Deploy repository. Typically, you store the deployable binary. However, Rational Team Concert already has a way to manage the deployable binary in packages and understands how to interact with native z/OS files. Therefore, you can let Rational Team Concert take care of the storage and transfer of the package. In the UrbanCode Deploy component, a small meta-data file is stored, which keeps track of the package information.

Figure 12 shows the deployment process of the CICS component. It is a simple process with two steps. Download the artifacts, the meta-data file that describes a package, and deploy using Rational Team Concert.

Figure 12. Process to deploy using Rational Team Concert
Steps to deploy using Rational Team Concert

In the deploy using Rational Team Concert step, set properties to specify the Rational Team Concert deployment definition to run, the ID of the package to deploy, and the connection information to Rational Team Concert in the advanced properties, as shown in Figure 13.

Figure 13. Properties of the deployment definition
Edit properties name, build ID, package label

The deployment process of the data component is similar to the CICS component except that a different Rational Team Concert process needs to be called.

The next step is to update the application process to include deployment of the two new components, as shown in Figure 14.

Figure 14. Application process with three components
Updated application process with new components

If you have unique deployment tools or processes to integrate, the UrbanCode Deploy plug-in architecture provides an open framework to write your own integration plug-in. After you have managed the deployment in UrbanCode Deploy, you can take advantage of its rich features including inventory view, snapshot, graphical process editor, versioning, environment management, approval controls, and integration with a wide range of software development lifecycle (SDLC) tools.

In addition to the actual deployment, UrbanCode Deploy can integrate with other tools within the software development lifecycle. It integrates test automation into the deployment process to verify the deployment. Figure 15 shows an enhanced deployment process with test automations.

Figure 15. Application process enhanced to include tests
Build verification test and mobile test added

The test automation process uses integrations with IBM® Rational® Quality Manager, the test management tool, and IBM® Rational Test Workbench, the test execution and service virtualization tool, as show in Figure 16.

Figure 16. Workflow of test process
Start, run test suite, add link, status to version

This enhanced deployment and testing process and the related products is shown in Figure 17.

Figure 17. Architecture diagram of deployment and testing products
Architecture diagram of deployment and testing products

ALT=Diagram of product relationships to application


Summary

This article describes the areas to consider for a z/OS and multi-platform deployment system. It includes two scenarios of how to use UrbanCode Deploy to help deploy z/OS applications. The first scenario shows how to deploy directly using the z/OS agent. The second scenario shows how to integrate with the existing deployment process. For more information about continuous integration, deployment and testing in z/OS, read the continuous integration for System z series of articles.

Resources

Learn

Get products and technologies

  • Download Rational Team Concert from Jazz.net and try it free on up to 10 developers for as long as you want (requires registration). If you'd prefer, you can try it in the sandbox instead, without installing it on your own system.
  • Download Rational Test Workbench, which includes Rational Integration Tester, from Passport Advantage.
  • Evaluate IBM software in the way that suits you best: Download it for a trial, try it online, use it in a cloud environment.

Discuss

Comments

developerWorks: Sign in

Required fields are indicated with an asterisk (*).


Need an IBM ID?
Forgot your IBM ID?


Forgot your password?
Change your password

By clicking Submit, you agree to the developerWorks terms of use.

 


The first time you sign into developerWorks, a profile is created for you. Information in your profile (your name, country/region, and company name) is displayed to the public and will accompany any content you post, unless you opt to hide your company name. You may update your IBM account at any time.

All information submitted is secure.

Choose your display name



The first time you sign in to developerWorks, a profile is created for you, so you need to choose a display name. Your display name accompanies the content you post on developerWorks.

Please choose a display name between 3-31 characters. Your display name must be unique in the developerWorks community and should not be your email address for privacy reasons.

Required fields are indicated with an asterisk (*).

(Must be between 3 – 31 characters.)

By clicking Submit, you agree to the developerWorks terms of use.

 


All information submitted is secure.

Dig deeper into Rational software on developerWorks


static.content.url=http://www.ibm.com/developerworks/js/artrating/
SITE_ID=1
Zone=Rational
ArticleID=962729
ArticleTitle=Multi-platform application deployment with UrbanCode Deploy
publish-date=02182014