Viewing usage statistics in Rational Test Control Panel
You can use IBM® Rational® Test Control Panel to
display the usage statistics of virtual services across Rational Test Virtualization
Server and IBM Rational Integration Tester.
About this task
Procedure
A. Server Configuration
- By default the metric data is stored in an H2 database
in the Rational Test Control Panel workspace.
The H2 database does not scale to long-term usage. To enable long-term
storage of metric data, you can edit the server configuration file
of Rational Test Control Panel to
use a Cassandra database. For more information about downloading,
installing, and setting up a Cassandra database, see Apache Cassandra.
- Go to the Rational Test Control Panel installation folder and locate the server configuration file. Typically on Windows systems, the file is in C:Program Files\IBM\RationalTestControlPanel\config and on non Windows systems, in /opt/IBM/RationalTestControlPanel/config.
- Open server.custom.xml in a text editor.
- Edit that file to configure Rational Test Control Panel with
the details that are needed to communicate with a Cassandra database.
For more information about a Cassandra database, see Apache Cassandra.
- To change the interval in which metric data is reported,
edit the Rational Test Control Panel server
configuration file.
- Go to the Rational Test Control Panel installation folder and locate the server configuration file. Typically, on Windows systems, the file is in C:\Program Files\IBM\RationalTestControlPanel\config and on non Windows systems, in /opt/IBM/RationalTestControlPanel/config
- Open server.custom.xml in a text editor.
- Edit the file and add the following code.
<!--Metric clients report every 300 seconds (by default). Metrics can be gathered more regularly if higher precision is required, but this will increase the storage and network bandwidth used--> <jndiEntry jndiName="metric/report_interval" value="300"/>
B. Usage
- Open the Usage page in Rational Test Control Panel to
see usage metrics for stubs. For more information, see Navigating the user interface. The metric data that is reported is as follows:
- The number of calls that are received by a stub. These calls are requests, messages, or other calls that are received by the stub.
- The number of calls that the stub virtualized. That is, the received calls that had their behavior changed, for example where the stub provided a response, or delayed response from the live system by the configured amount, or simulated an error response.
Metric data is reported every 5 minutes or when the last stub shuts down.
- To see usage metrics for stubs, do one of the following
tasks:
- Start stubs from Rational Test Control Panel. For details, see Starting stubs: Rational Test Control Panel method.
- Run stubs from the Rational Integration Tester command-line (RunTests command) or Ant task. For details, see Run tests by using the command line or Run tests by using an Ant task.
- Run stubs from the Rational Integration Tester interface. For details, see Executing a test asset.
Note: When domain-level security is enabled, the Usage page is only visible to users with the Rational Test Control Panel system administrator role. When LDAP or Active Directory is in use, the system administrator role is assigned to user groups by the user who installs Rational Test Control Panel. For more information about domain-level security, see Security considerations for Rational Test Control Panel. - To filter results by week or by year, use the Period field. The default view is for the last week by hours. You can change the view to show results for a year by day. To filter results by domain if you are running stubs from Rational Test Control Panel, use the Filter by domain field to filter results by domain.
C. Optional client configuration
- To switch off metrics set the RTVS_METRIC_MODE environment
variable to OFF for the IntegrationTester executable,
the RunTests executable, the agent's RunTests executable, or the Ant
task executable. Any value other than OFF results
in an attempt to connect to the server identified by the RTVS_METRIC_URL environment
variable or, if that is not set, the server that is chosen as the Rational Test Control Panel server
in the project settings. Important: Using an empty RTVS_METRIC_URL is not equivalent to setting RTVS_METRIC_MODE=OFF.
- By default Rational Integration Tester and Rational Test Virtualization
Server report
metrics to the Rational Test Control Panel server
configured in the Rational Integration Tester project.
You can override this default behavior and report metrics to a different
server by one of the following ways:
- By setting an environment variable that is visible to the
IntegrationTester executable, the RunTests executable, the agent's
RunTests executable, or the Ant task executable. For example, on Windows Systems:
set RTVS_METRIC_URL=http://localhost:7819/metric
- By setting the path to a different server in the application.ini file,
the IntegrationTester.ini , or RunTests.ini as
a JVM argument. For example:
-DRTVS_METRIC_URL=http://localhost:7819/metric
The JVM argument takes precedence.
- Metrics are reported to Rational Test Control Panel by
the RunTests engine and the IntegrationTester workbench. If use of
a corporate HTTP proxy is required to enable this connectivity, it
can be configured by setting the http_proxy environment
variable. An example syntax of http_proxy is:
http://my.proxy.com:3128
Note: The RunTests engine is used in both Rational Integration Tester, Rational Test Virtualization Server and from the IntegrationTester Ant task. The above advice applies to configure use of the corporate HTTP proxy with all of these applications.
- By setting an environment variable that is visible to the
IntegrationTester executable, the RunTests executable, the agent's
RunTests executable, or the Ant task executable. For example, on Windows Systems:
D. Deleting data
- To delete old data you can do one of the following options:
- When a Cassandra data store is used you can set a time-to-live (TTL) mechanism with the stored data, so data can be automatically removed. This mechanism is set up by changing the property kairosdb.datastore.cassandra.datapoint_ttl in C:\Program Files\IBM\RationalTestControlPanel\usr\servers\RTCPServer\apps\kairosdb.war\WEB-INF\kairosdb\conf\kairosdb.properties. To apply this setting, restart Rational Test Control Panel.
- When the default H2 data store is used no automatic data removal is possible, the H2 data store can be purged by removing the directory C:\IBM\RTCP-Workspace\kairosdb\h2db while Rational Test Control Panel is not running.
- Specific data point ranges can be deleted by using the KairosDB
development interface on the system where Rational Test Control Panel is
installed at http://localhost:7828/.Note: The http://localhost:7828/ interface can be accessed only by browsers that are running on the same system as Rational Test Control Panel. It cannot be accessed remotely.
E. Advanced client configuration
- To store additional information against the metric data,
you can set more environment variables for the IntegrationTester executable,
the RunTests executable, the agent's RunTests executable, or the Ant
task executable.
The following example adds who metadata to any metric data stored, which might enable more useful reports, for example, to report who is using the stubs the most. However, storing extra data has an extra cost on storage so you want to be conservative, especially if you are using only an H2 database rather than a Cassandra database.
set RTVS_METRIC_ALIAS_who=%USERNAME%
Note: You can also add fixed values by using Library Manager. By doing so, you keep the configuration within the Rational Integration Tester Agent installation. For example, to record the Rational Integration Tester Agent name that is running stubs, run Library Manager (on the system where Rational Integration Tester Agent is installed) and add an entry on its own line to the text box labeled JVM Arguments:
Restart the Rational Integration Tester Agent and your stubs to enable the saving of the agent name.-DRTVS_METRIC_ALIAS_agent=myAgent1
Feedback