Skip to main content

By clicking Submit, you agree to the developerWorks terms of use.

The first time you sign into developerWorks, a profile is created for you. Select information in your developerWorks profile is displayed to the public, but you may edit the information at any time. Your first name, last name (unless you choose to hide them), and display name will accompany the content that you post.

All information submitted is secure.

  • Close [x]

The first time you sign in to developerWorks, a profile is created for you, so you need to choose a display name. Your display name accompanies the content you post on developerworks.

Please choose a display name between 3-31 characters. Your display name must be unique in the developerWorks community and should not be your email address for privacy reasons.

By clicking Submit, you agree to the developerWorks terms of use.

All information submitted is secure.

  • Close [x]

Using IBM Rational Performance Tester: Resource monitoring Part 1, Reporting and scheduling

Ashish Patel (ashishp@ca.ibm.com), IBM Performance Optimization Toolkit (IPOT) Architect and Lead Developer, IBM Toronto Lab
Ashish Patel
Ashish Patel is a software architect and development lead working at the IBM Toronto Software Lab in Canada. He has more than seven years of industry experience in software architecture and development, and four years of business development and entreprenuerial experience. He participated in IBM’s premiere internship program, Extreme Blue, where he co-founded the IBM Performance Optimization Toolkit. He has worked with IBM for two years on numerous start-up products in the software development and test area. Prior to joining IBM, he created software solutions for one of the largest integrated petroleum companies in the world and one of Canada’s top providers of energy. He also founded a privately held software development and consultancy firm, where he was appointed the president and chairman of the corporation, which he operated for four years. He also holds a computer engineering degree from the University of Alberta.

Summary:  This article describes some of the basic tasks common to resource monitoring with IBM Rational Performance Tester, including configuring a performance monitoring schedule, customizing reports, and overlaying performance counters.

Date:  17 Apr 2007
Level:  Intermediate
Also available in:   Chinese

Activity:  6437 views
Comments:  

Overview

Resource monitoring is a term used to describe the observation of a property or asset over time. Typically, these observations are numerical facts or data, also known as statistical data. Most often within the performance testing space a resource can be, but is not limited to, a physical system or a process executing on a system. Resource monitoring is crucial when trying to determine the problem with an application that is failing to perform at reasonable levels, because this type of monitoring allows a performance tester to determine whether there is a lack of system-level resources or an issue with the application itself.

The resource monitoring feature in IBM® Rational® Performance Tester allows real-time monitoring of systems and system processes. This granularity enables problem determination analysts to diagnose a problem accurately; as the resource monitoring data can help an analyst determine if the failure was caused by the lack of system resources (such as memory) or a particular process (such as a database) involved in an applications execution.

There are three resource monitoring data collectors provided in Rational Performance Tester:

  • Windows™ Performance Monitor for Microsoft® Windows® systems
  • rstatd for Linux®/UNIX® systems
  • IBM Tivoli® Monitoring (ITM) for monitoring a variety of platforms

Data collectors extend a generic Resource Monitoring platform, which is included in Performance Tester (See Figure1, the IBM Rational Performance Tester stack architecture). Additional data collectors can be added into the product using Eclipse™ Platform extensions, which will then be automatically loaded by the Resource Monitoring platform.


Figure 1. IBM Rational Performance Tester stack architecture
image of architecture stack

Because each data collector will have a specific mechanism for retrieving data from a remote host, the Resource Monitoring platform is designed to allow custom Java™ code to be written to implement the data collection mechanism using a common interface.

Once the data is retrieved, the data must be transformed into the Eclipse Test and Performance Tools Platform (TPTP) statistical model format. This model format is based on the Eclipse Modeling Framework (EMF) and is designed to be a generic method of storing statistical data using XML. The open source Eclipse TPTP project provides APIs that abstract the details of storing this data and make is easy to store retrieved data.

All of the data collectors provided in Performance Tester have a specific mechanism of retrieving data; however, once the data is gathered the collectors transform this data into the common statistical model format. Thereby, Performance Tester and other Eclipse-based views to render reports based on this data.

The description and configuration of these data collectors are discussed in Parts 2, 3, and 4 of this article.

Configuring a performance schedule

Resource monitoring is enabled when configuring a performance schedule. Selecting the top-most node in the Schedule Contents section of the Performance Schedule Editor. Figure 2 displays configuration parameters available in the Schedule Element Details section. A tab labelled Resource Monitoring contains the configuration parameters that are used when the schedule in context is executed.


Figure 2. Performance Schedule Editor
image of workspace

Let us explain some of the choices and actions:

  • Enable resource monitoring: This check box activates the resource monitoring feature for the performance schedule you are working with. It can be used as an on or off switch for resource monitoring as a whole.
  • Ignore invalid resources when executing the schedule: Select this check box to suppress error messages about resource monitoring data sources. These errors can occur if the data sources are unreachable or invalid. If you select this option, you must view logs to see the error messages.
  • The Data Source table in the Resource Monitoring tab displays the configured data sources that are collected from when this schedule executes. If this is a new schedule, the Data Source table will be empty. If you have previously added resource monitoring data sources to this schedule, you can Edit or Remove them. Remove does not delete the data source from the file system; it merely removes it from this view because other test schedules or applications might still use the data source.
  • Clicking Add New (see Figure 2) creates and allows a user to configure a new resource monitoring location:
  • Host (Figure 3), indicates the target host name (Internet Protocol (IP) address for fully qualified host name) to monitor during the execution of the performance schedule.

Tips:

  • When using IBM Tivoli Monitoring as the data source, the host field is the location of the resource management collection agent (or monitoring agent) and not the Tivoli Enterprise Monitoring Server.
  • When using Windows Performance Monitor or UNIX rstatd monitor as the data source, the host field is the target Windows or UNIX system that has to be monitored.
  • Numerous data collectors are available in the Data Sources list. If required, several data sources can be configured for one location by selecting the desired data sources from the check box list on the left-hand side of the dialog.

Figure 3. Create and configure a new resource monitoring location
image of dialog box
  • Click Add Existing (Figure 2) if you have existing locations in your workspace that you want to add and configure to the current working performance schedule.

Figure 4. Add existing location to a performance schedule for resource monitoring
image of dialog box

Once you have enabled resource monitoring you have to specify the data sources to collect from.

Any configuration changes you make for a particular data source are stored with that location. This means that you have to set up a data source only once. If you export a schedule, it will contain the data source configuration information. This includes potentially sensitive information, such as stored passwords.

It is important to note that to capture accurate resource monitoring data, you must ensure that the clocks on all systems are synchronized. If you do not synchronize the clocks on the workbench and on all of the systems under test, resource counters are displayed inaccurately (with respect to time) in the reports.

Customizing reports and overlaying counters

Performance Tester's report infrastructure allows for display of rich interactive graphs and tables. To aid in problem determination, each graph in the report infrastructure has been enhanced to allow resource data to be placed over the already rendered graphs. This action allows one to correlate two separate data sets, such as page response time and % processor time. Correlation of resource data with response time data help an analyst to determine if there is an issue with the system, capacity of the environment, or the application itself.

There are two ways to overlay counters on a report:

  1. Add performance counters to an existing graph.
  2. Drag-and-drop counters onto an existing report.

Add performance counters to an existing graph

Right-click on an existing graph and select Add/Remove Performance Counters > Resource Monitoring Counter (Figure 5) to display the Resource Counters configuration dialog. This menu item is available from any graph in the Performance Report view.


Figure 5: Overlay resource monitoring counter on an existing report
image of dialog box

The Resource Counters configuration dialog (Figure 6) allows you to select specific counters and adjust the scaling factor for each counter. Adjusting the scaling factor for a counter is important when trying to analyze correlation between counters that have different data types. For example, processor time is a percentage quantity where as memory is measured in bytes.


Figure 6: Resource Counters configuration dialog
image of dialog box

Once the counters are selected and the configuration dialog is complete, the counters are drawn on the selected graph (Figure 7). Hovering over any data point using the mouse will provide a tool-tip containing information about the data point, such as the value of the observation.


Figure 7: Response vs. Time summary correlated with the % Processor Time resource counter
image of dialog box

Drag-and-drop counters onto an existing report

Drag-and-drop counters from the Performance Test Run view onto an existing report, as shown in Figure 8. Expanding the tree control in this view allows the user to select specific counters. The tree is organized by the host name, under which are listed the data collection agents, such as UNIX rstatd monitor.


Figure 8: Drag-and-drop a resource counter from the Performance Test Run view
image of dialog box

A suggested report to modify with user-defined counters is the Resources report, the last tab in the Performance Report view, as shown in Figure 9. This report spans the entire view allowing more working area than other reports in the view.

The layout of the graph can also be customized using the Customize menu item when you right-click on the graph. This action allows you to set the X and Y axis limits, legend, and change the time range.


Figure 9: Resources report in a performance report
image of dialog box

Conclusion

The procedures described here are common to resource monitoring using IBM Rational Performance Tester, in the succeeding parts to this article we will describe how to configure the resource monitoring data collectors provided for Rational Performance Tester:

  • Windows™ Performance Monitor for Microsoft® Windows® systems
  • rstatd for Linux®/UNIX® systems
  • IBM Tivoli® Monitoring (ITM) for monitoring a variety of platforms

Resources

Learn

Get products and technologies

Discuss

About the author

Ashish Patel

Ashish Patel is a software architect and development lead working at the IBM Toronto Software Lab in Canada. He has more than seven years of industry experience in software architecture and development, and four years of business development and entreprenuerial experience. He participated in IBM’s premiere internship program, Extreme Blue, where he co-founded the IBM Performance Optimization Toolkit. He has worked with IBM for two years on numerous start-up products in the software development and test area. Prior to joining IBM, he created software solutions for one of the largest integrated petroleum companies in the world and one of Canada’s top providers of energy. He also founded a privately held software development and consultancy firm, where he was appointed the president and chairman of the corporation, which he operated for four years. He also holds a computer engineering degree from the University of Alberta.

Report abuse help

Report abuse

Thank you. This entry has been flagged for moderator attention.


Report abuse help

Report abuse

Report abuse submission failed. Please try again later.


developerWorks: Sign in


Need an IBM ID?
Forgot your IBM ID?


Forgot your password?
Change your password

By clicking Submit, you agree to the developerWorks terms of use.

 


The first time you sign into developerWorks, a profile is created for you. Select information in your developerWorks profile is displayed to the public, but you may edit the information at any time. Your first name, last name (unless you choose to hide them), and display name will accompany the content that you post.

Choose your display name

The first time you sign in to developerWorks, a profile is created for you, so you need to choose a display name. Your display name accompanies the content you post on developerWorks.

Please choose a display name between 3-31 characters. Your display name must be unique in the developerWorks community and should not be your email address for privacy reasons.

(Must be between 3 – 31 characters.)

By clicking Submit, you agree to the developerWorks terms of use.

 


Rate this article

Comments

Help: Update or add to My dW interests

What's this?

This little timesaver lets you update your My developerWorks profile with just one click! The general subject of this content (AIX and UNIX, Information Management, Lotus, Rational, Tivoli, WebSphere, Java, Linux, Open source, SOA and Web services, Web development, or XML) will be added to the interests section of your profile, if it's not there already. You only need to be logged in to My developerWorks.

And what's the point of adding your interests to your profile? That's how you find other users with the same interests as yours, and see what they're reading and contributing to the community. Your interests also help us recommend relevant developerWorks content to you.

View your My developerWorks profile

Return from help

Help: Remove from My dW interests

What's this?

Removing this interest does not alter your profile, but rather removes this piece of content from a list of all content for which you've indicated interest. In a future enhancement to My developerWorks, you'll be able to see a record of that content.

View your My developerWorks profile

Return from help

static.content.url=http://www.ibm.com/developerworks/js/artrating/
SITE_ID=1
Zone=Rational
ArticleID=209364
ArticleTitle=Using IBM Rational Performance Tester: Resource monitoring Part 1, Reporting and scheduling
publish-date=04172007
author1-email=ashishp@ca.ibm.com
author1-email-cc=rhalden@us.ibm.com

Tags

Help
Use the search field to find all types of content in My developerWorks with that tag.

Use the slider bar to see more or fewer tags.

For articles in technology zones (such as Java technology, Linux, Open source, XML), Popular tags shows the top tags for all technology zones. For articles in product zones (such as Info Mgmt, Rational, WebSphere), Popular tags shows the top tags for just that product zone.

For articles in technology zones (such as Java technology, Linux, Open source, XML), My tags shows your tags for all technology zones. For articles in product zones (such as Info Mgmt, Rational, WebSphere), My tags shows your tags for just that product zone.

Use the search field to find all types of content in My developerWorks with that tag. Popular tags shows the top tags for this particular content zone (for example, Java technology, Linux, WebSphere). My tags shows your tags for this particular content zone (for example, Java technology, Linux, WebSphere).

Try IBM PureSystems. No charge.

Special offers