Welcome to the Data Center Automation Blog, where you can read the perspectives from storage management experts. This Blog provides insights into the data center automation solution, as well as technical details about specific IBM products.
"The Majority Rules !"
In a nutshell, you have Quorum if you have the majority.
Quorum is the number of "operational" nodes in a cluster that are required to control the resources, modify the cluster definition, or perform certain cluster operations.
The main goals of quorum operations:
- identify who has the majority when a cluster is broken up into sub-clusters
- keep data consistent, especially when shared file systems are being used
- protect critical resources … maintain HA control
A Network TieBreaker is a popular configuration option for a Tivoli System Automation for Multiplatforms (TSA MP) managed environment.
But what is a TieBreaker and why is it needed ? To understand the what and why, you first need to understand the concept of "quorum" ... please see my blog titled "TSA Blog Series: High Availability Concepts - What is Quorum ?" https://www.ibm.com/developerworks/community/blogs/d6a38b59-943a-434b-a473-b408ed64847d/entry/what_is_quorum?lang=en
... in a nutshell, a... [More]
Ever tried to bring a resource offline only for it to result in a state of "Stuck online" ?
A "Stuck online" situation could also prevent a move request (failover) since the first step of a move is to stop/offline all resources that are in the scope of the move.
Your first sign of a "Stuck online" situation will likely be from the output of the 'lssam' command. Here is some sample lssam output :
Stuck online... [More]
Given a 2 node domain, what option do you have to allow a single node to obtain Operational Quorum after bringing one node offline and knowing your TieBreaker device will not be accessible from the surviving node ?
Firstly, if you want to know more about "Quorum", check out one of my earlier blogs:
There are a number of scenarios where clients have ended up with a surviving... [More]
Here are some power-user commands mainly for servicing SA MP which I have gathered over time and are worth sharing. They can be made into shell aliases or just used as is. Have fun!
Get SAMP version
Get RSCT version
Check operator commands
Check operator commands on every node in the cluster
for NODE in `lsrpnode -x | cut -f1 -d' '` ; do ssh $NODE cat /var/ct/IBM.RecoveryRM.log; done
For AOTC members and people interested in System Automation Product Family - there is an exciting change for our 2012 AOTC event. For the first time in 2012, the Automated Operations Technical Council (AOTC) joins IBM Pulse at the MGM Grand in Las Vegas March 4-7, 2012 and we invite you to take part in the action! AOTC 2012 will offer four full days of sessions focused on the IBM Tivoli® System Automation family of products - SA z/OS, SA for Multiplatforms and SA Application Manager. The first three days will be open to all Pulse attendees.... [More]
The Tivoli Provisioning Manager development team has implemented usability testing in the Agile development process. By allowing customers to experience the product while in development, we are building a strong partnership with our customers to shape the solution that they need. Here are the main points that we followed to be able to fit formal usability testing into the Agile schedule. By doing so, our team greatly improved the task flow and user interaction for the features tested. 1. We created a team Our usability team is... [More]
"Consolidation drives value." "Manage less and do more."
These initiatives, and many others like them, make sense from a financial standpoint, but can often lead to sleepless nights for operations managers once they realize the majority of their business, sometimes as much as 85%, is now run out of a single datacenter or a single platform. What happens when the system goes down? What happens when my datacenter loses connectivity? How quickly can I recover from an outage? Do I... [More]
In a previous blog, I talked about the importance for collecting and providing diagnostic data. For the Tivoli System Automation for Multiplatforms (TSA MP) product, this means running its automated data collection utility called "getsadata".
However, there are details about a problem situation that cannot be obtained by a tool, script, or bunch of commands. The most obvious is the problem description itself. So what does a good problem description entail ?
Well a timeline for one. Lets say Support staff have to dig into... [More]
The Tivoli System Automation development team just released a whitepaper on SAP High Availability with Tivoli System Automation for Multiplatforms on AIX and Linux.
This paper describes an approach to creating a highly available SAP solution that covers all critial components. The IBM High Availability (HA) middleware solution (Tivoli System
Automation for Multiplatforms) provides this level of high availability.
High availability is a term used to describe systems that are continuously available that... [More]
Today we added a new utility to the SA Application Manager WIKI which allows to model tasks as SA resources. This utility can be used together with the Agentless Adapter of the SA Application Manager as well as for the instrumentation of resources in SA for Multiplatforms. What are task resources?
With System Automation it is possible to
manage the availability of all resources in a datacenter. System Automation
ensures the availability 24x7 by constantly monitoring the availability of defined
resources and automatically reacts on... [More]
I just wanted to take a moment to spread the word about a new performance cookbook resource available from the IBM Service Management (ISM) Library. You can find it here: Tivoli Provisioning Manager Version 18.104.22.168 Performance Cookbook This cookbook is based on the latest available version of TPM 7210 and combines all the most recent performance improvements available. Performance areas discussed in the cookbook include: Functional Overview Architectural Overview Performance Overview Deployment Infrastructure Runtime Performance... [More]
If you're writing workflows you have no doubt encountered the DCMQuery/Insert/Update functions. They rely on an archaic DCMAccess notation which can be difficult to figure out, especially for very complex queries. The main point is that you start with some known information and from that known you gather new info based on data model relationships. Certain objects have certain relationships and therefore you can link from one item to the next based on this context. Sort of like the game '7-degrees of Kevin Bacon'. Sort of. To make this... [More]
Tivoli System Automation Application Manager 3.2.2 has released its first pre-canned End-to-end policy. This policy is called "End-to-end Disaster Recovery with DB2 HADR" and is available on the ISM Connect library: http://www-304.ibm.com/software/brandcatalog/ismlibrary/details?catalog.label=1TW10SA08# It is a disaster recovery (DR) solution with System Automation Application Manager as single point of control for operating and disaster recovery actions. Application data is replicated software-based with IBM DB2 high availability... [More]
IBM Tivoli System Automation for Multiplatforms
- Introduction & Overview -
A software solution that leverages policy-based, self-healing and cross-platform application automation capabilities to realize monitoring and operation of a multitiered environment, manage outages, automatic recovery and movement of resources. (Tivoli System Automation for Mutiplatforms will be abbreviated as SAMP in this article.)
High availability : A system that is continuously available and... [More]
Should we or shouldn't we? The typical question of the IT Manager when her/his datacenter automation software releases a new fixpack. This question stems from prior nightmares attempting to deploy fixes that were half-baked, poorly documented and delivered in haste. I'm not an 'alpha' adopter but I certainly am an early adopter. The reasoning I take into deploying a new fix or new release fixpack is that I want the newest features, I want the bugs corrected - especially if there is a specific one that I'm subscribed to, and I want the... [More]
We're very close to our first Open Program Call on Tivoli System Automation Application Manager(https://ibm.biz/BdxKhQ) Main focus of this call is the new User Interface we intend to ship based on that new platform in a v3.next release. We'll post a recording on our Open Program developerWorks community (https://ibm.biz/BdxSCL)- stay tuned!
The IBM Tivoli Provisioning Manager development team continues to enhance the next release (TPM v8.1) with new features and usability improvements which are targeted for future delivery. We have just announced the availability of our first BETA. If you are an existing TPM customer or stakeholder and would like to participate in the BETA and provide feedback, please contact Kimberly Mungal (firstname.lastname@example.org) to join the TPM 8.1 Early Access Program.
in case you haven't seen this so far...... With the introduction of Tivoli System Automation Application Manager (SA Application Manager) version 22.214.171.124 (available since Q4 2011) the SA Application Manager has been enhanced to automate (start/stop) resources that are monitored by IBM Tivoli Monitoring (ITM).This new capability allows ITM customers to not only monitor SW components, but also control and automate SW components which are so far monitored by ITM. A simple example is a multi-tierd online banking application with software... [More]
Starting from October 14th, Tivoli Provisioning Manager for OS Deployment and Tivoli Provisioning Manager for Images documentation is available also in ePub format at the following links: Tivoli Provisioning Manager for OS Deployment: http://publib.boulder.ibm.com/infocenter/tivihelp/v52r1/topic/com.ibm.tivoli.tpm.osd.doc/welcome/osd_pdf_epub.html Tivoli Provisioning Manager for Images: http://publib.boulder.ibm.com/infocenter/tivihelp/v52r1/topic/com.ibm.tivoli.tpm.osdimg.doc/welcome/osdimg_pdf_epub.html This new format complements the... [More]
I am pleased to announce that Tivoli Provisioning Manager for OS Deployment and Tivoli Provisioning Manager for Images Fixpack 8 (including System-x Edition) have been shipped and can be downloaded from Fix Central. This release delivers 14 APARs, internal defects and minor enhancements to our customers, plus a complete refresh of InfoCenter. Notice that this fixpack is a full build so that the IBM ID needs to be entitled to download it from fixcentral. If a customer or IBMer is experiencing a problem with the entitlement, suggest the... [More]
System Automation Application Manager has recently been released in a new Version "3.2.2" !!! Following is a short summary list of new features: Support of zEnterprise environmen With the new version of SA Application Manager we are introducing a new way of not only managing resources
hosted on systems but also to control the hosting environments - starting and stopping the systems. SA Application Manger cross-site failover - working with GDPS-DCM The SA Application Manager can now fail over from one site to another, which works... [More]
This self-paced audio-visual course provides an overview of the System Automation for z/OS 3.4 functional differences as they relate to implementation and administration. This is is the first of three courses in a set of courses that cover implementation and administration differences. The other two courses provide demonstrations and additional details on specific topics. The functional differences associated with operational commands are covered in a separate set of courses. Link: http://youtu.be/VsipoR6n52Q
A new developerWorks article has been published, which helps Tivoli System Automation users get up and running. This new Getting Started Guide was written by Frank Goytisolo, an IBM IT Specialist who has spent several years working with Tivoli System Automation for High Availability (TSA). Here is an excerpt from the overview: The purpose of this guide is to introduce Tivoli® System Automation for
Multiplatforms and provide a quick-start, purpose-driven approach to
users that need to use the software, but have little or no past... [More]
The Open Program for IBM Tivoli System Automation started.
We are developing the next version of our products:
Tivoli System Automation Application Manager (SA AppMan)
Tivoli System Automation for Multiplatforms (SA MP)
In the Open Program, we are going to
show you selected features and improvements that we intend to include in
future releases of SA AppMan and SA MP. We are looking forward to
discuss these features and improvements with you and receive your
You have the chance to... [More]
If you're planning on asking IBM Support for help, more than likely there will be a minimum amount of detail they will need up front. The most obvious being details about your environment, such as platform/OS and product versions.
Now if you're needing the root cause for some event that has since pasted, then keep in mind that someone providing "remote" support will likely need historical log or trace data before they will be able to offer you anything significant.
For the Tivoli System Automation for... [More]
Automation with Tivoli System Automation products family in virtual environments has been presented on the GSE Power-Systems conference in Munich on 21.11.2011. Virtualization technologies play an important role in datacenters – they also provide the base for currently hot discussed “cloud” infrastructures. There is a lot of focus on virtualization technologies for distributed server platforms like zVM, VMware, System p’s Hypervisor, SUN Solaris Zones, and others. Of course, virtualization provides several benefits this presentation... [More]
The tool appcmd can be used for testing policies of IBM Tivoli System Automation for Multiplatforms and policies of IBM Tivoli System Automation Application Manager Agentless Adapter. You can use it to instrument IBM.Application or IBM.RemoteApplication resources. appcmd simulates resources, allows to mimic failures and tracks the execution of commands which makes it a useful tool to develop and test policies. We publish appcmd in version 4 for free in our IBM System Automation for Multiplatforms Wiki page here ... [More]
In How Tivoli Provisioning Manager integrated usability testing in Agile - Part 1 we talked about 3 points on how usability testing fits into the development cycle. In part 2, I will be sharing some other points to make this activity successful. 4. We tested “anything” By testing items that were not complete, we received excellent feedback about the end-to-end customer scenarios and important features that were needed. For example, we tested various designs to validate the general flow of a task from the business perspective. The feedback... [More]