Hot off the press is a new Redbook on InfoSphere Optim Performance Manager and InfoSphere Optim Query Workload Tuner here: http://www.redbooks.ibm.com/abstracts/sg248111.html?Open
You'll find architectural overviews, planning and installation guidance, feature overviews, as well as usage scenarios. This is a great reference whether monitoring transaction processing or business intelligence workloads.
Let us know if you find this helpful!
One of the issues that users have raised to me is the impedance mismatch between our web-based tools and our eclipse-based tools, in particular, between InfoSphere Optim Performance Manager (Performance Manager) and InfoSphere Optim Query Workload Tuner (Query Tuner). Query Tuner availability on the Eclipse platform grew out of our rich investment in Eclipse and our strategy to drive improved query performance early in the development cycle. Thus, key integration with Data Studio and Rational development features were, and continue to be, highly valued.
Key use cases for performance management involve using Performance Manager to identify high cost queries and transfer them to Query Tuner for analysis and advice. Performance Manager makes it easy to identify high cost queries (either long running queries or short queries that are costly in aggregate) or to identify query workloads that are not meeting their response time targets. The handshake between Performance Manager and Query Tuner provides the full problem identification through problem resolution support. However, Performance Manager provides a web console and Query Tuner is an Eclipse-based client, so there is a transition that can be unexpected, and for some, unwelcome. With the new releases coming in June, we are embarking on delivering query tuning features directly in the web console! This release is a first step, so all features are not available, but it is indicative of our direction to make the cycle of problem identification through problem resolution a seamless experience. When the Eclipse client is installed and open, we will still transfer the queries to the Eclipse client since it has the full query tuning function.
Features available from the web will now include the ability to:
Re-explain a query or workload
Format and annotate a SQL statement
Get statistics advice for a query or workload
Get index advice for a query or workload
Generate, store, and share reports containing the advice
The screen capture below previews the query tuning tab right inside the Performance Manager web console. The embedded job manager in Performance Manager is used to execute the query tuning jobs. All the submitted query tuning jobs can be viewed and selected in the grid including their status and progress.
Features still requiring the Eclipse client are:
Visual Explain and Access Path Explorer (yes, we know this is a priority and we are working on it )
Access Plan Advice and Workload Access Plan Advice
Access Plan Compare and Workload Access Plan Compare
Statistical View Advice
Materialized Query Tables Advice
Multidimensional Clustering Advice
Partition Distribution Advice
Table Organization Advice (new in this Query Tuner release in support of BLU Acceleration)
Test Candidate Indexes
Plan Hints Support
Workload Capture (from other sources) and Workload Management
Also, you still need the Query Tuner license activated on the target database to be able to use the function from the Performance Manager web console. The license activation capability is still in the Query Tuner Eclipse client.
Hope you will enjoy this new function. Give us some feedback on our Query Tuner forum or post a question here.
Here is my promised update on InfoSphere Optim Performance Manager (OPM) 5.1.1 that will be available April 30th. As I mentioned in my earlier posting Optim Releases Support DB2 10, the majority of the enhancements are in support of DB2 10 features, so let me go over those first:
- Multi-temperature support – DB2 10 multi-temperature data management allows you to store different portions of your data on different classes (speed and cost) of storage so that you can match access requirements to underlying storage and non-disruptively change them over time as data ages and as access requirements change. “Storage groups” are used to define the different classes of storage and tables spaces are now defined within a storage group. OPM adds monitoring support for storage groups showing the table space to storage group relationship on alerts and dashboards and provides a new storage group report to understand utilization and growth. In addition, DB2 Workload Manager (WLM) was enhanced to enable prioritization based on the storage group of the data accessed. These features are enabled through the OPM user interface as well
- Multiple HADR – DB2 10 supports configuring multiple standbys now. OPM has improved alerting for high availability and disaster recovery (HADR) environments including additional alerts regarding standby connection and readiness, alerts regarding logging issues between the primary and standby, and distinguishing a single failed standby from last remaining failed standby.
- pureScale – DB2 10 continues to enhance the pureScale feature and OPM continues to enhance its monitoring of pureScale deployments. New alerts recognize cluster alerts failure, additional state changes in the cluster facility, and threshold alerts on group buffer pool hit ratio and cluster cache facility virtual memory, and page reclaim rate. DB2 10 enables WLM for use with pureScale and OPM is enhanced to support that configuration as well.
- WLM Dispatcher – DB2 10 provides a new WLM dispatcher feature that allows you to manage what percentages of CPU resources are assigned to service classes. OPM surfaces the options for dispatcher shares and limits in the OPM WLM configuration panels.
In addition, there are a few enhancements apart from DB2 10 support I want to mention that I think you’ll be excited about.
- User-defined Alerts – We get requests for additional alerts that are beyond our ability to fit into plan in the short term. Thus we are enabling user-defined alerts which will give you the ability to write your own SQL or scripts to detect issues and link them into the OPM standard alerting, notification, and blackout infrastructure. Now you can generate alerts for errors in db2diag.log, canary queries, or other alerts important to your environment. We will have some sample scripts in the Information Center. .
- More granular collection intervals – OPM configuration is based on user-specified collections intervals. Now you can specify different collection intervals for different kinds of data. For example you might want to collect buffer pool information every minute but table space information every hour.
- At-a-Glance performance overview and baseline – Finally, and for me the most exciting, is our introduction of baseline support. This is actually just the first step in a series of planned enhancements in this area. The At-a-Glance view appears in the Overview dashboard as a new tab and provides a higher level view of system activity: CPU distribution overall as well as within DB2, workload, and specific tabs for examining locking, I/O, and SQL processing. From here you can set baselines using the time slider to select the baseline timeframe. Once a baseline is set, the At-a-Glance values are automatically compared to the baseline and significant deviations indicated. Here’s a simple example of the At-a-Glance view
More information, including the Information Center updates, will be available with the general availability.
Holly Hayes, InfoSphere Optim Tools Product Manager
I’m hoping that you
saw the big DB2 10 for Linux, UNIX, and Windows announcement or will be attending the virtual conference The Future of Database and Data Warehousing Software today through Thursday. Concurrent with
the upcoming delivery of DB2 10, scheduled for April 30th, our
InfoSphere Optim tools team is planning a set of releases designed to provide
support for the new DB2 10 features. We hope these enhancements will help
you get going with new features including time travel query, row and column
access control, multi-temperature storage, adaptive compression, and query
performance improvements. The new releases are:
Data Architect V8.1
Optim Query Workload Tuner V3.1.1
Optim pureQuery Runtime V3.1.1
Optim Performance Manager V5.1.1
Optim Configuration Manager V2.1.1
Optim High Performance Unload V4.2.1
Merge Backup V1.1.1
Recovery Expert V3.1.1
The new capabilities help developers, DBAs, or security
develop, and deploy temporal tables, develop and validate time travel
queries, or access and view row history.
recommendations for adaptive compression use, deploy compression, and
validate compression savings.
to safeguard data enabling security administrators to define, view, and
deploy row and column access control and DBAs to analyze the impact of new
security controls and update routines accordingly.
the value of multi-temperature storage by monitoring storage group access,
analyzing storage group growth and contents, enabling WLM configurations
to prioritize queries against high performing storage, and automating
period roll-off for range partitioned tables to lower cost storage.
access plan improvements and regressions based on new optimization
strategies and get actionable recommendations for improvements.
multiple standby availability and alert availability risks.
Furthermore, InfoSphere Optim tools continue to extend support
for production deployments of DB2 pureScale environments with added
configuration, administration, and monitoring capabilities. Developers will
benefit from new tool support that facilitates application migration and
co-existence, with added support for PL/SQL procedure profiling and Oracle
database federation definition.
And those are just the
enhancements focused on DB2 10. Over the next few weeks, we’ll be blogging on
the releases in detail including enhancements not mentioned here.
And stay tuned!
Holly Hayes, Optim Tools Product Manager
Updated on December 15th to correct announcement letter URLs.
More news from Optim land to help you manage DB2 performance.
We just announced and today released a new version of IBM InfoSphere
Optim Performance Manager 5.1 (for DB2 for Linux, UNIX and Windows servers) and
a new product offering IBM InfoSphere Optim Configuration Manager 2.1, which is
available for both DB2 for z/OS and DB2 for Linux, UNIX and Windows servers.
InfoSphere Optim Performance Manager 5.1 is a major release
in which we re-architected the server to take advantage of the DB2 9.7
state-of-the-art in-memory metrics monitoring capabilities. We significantly reduced monitoring overhead
and increased scalability for monitoring partitioned systems, reduced disk
footprint for performance data, and improved retrieval times. I encourage you to read about all the new
features in the announcement
letter, but here are a few of my favorites:
- All dashboards that use in-memory metrics data collection now feature
the ability to display data collected at any point in time, whether now,
yesterday, last week, or last year. I particularly like the ability to view trends instantly by just selecting the time frame.
- Performance history needed for need to detect trends, plan capacity and
for service reporting now has
automated rolling aggregation at 4 level with user-defined retention periods so you can keep data longer at lower cost.
- List, filter, sort, analyze, and report on database connections and
resource consumption across server, I/O, row, transaction, locking,
communication, and utilities.Pretty much anything you would want to see about connections.
- Lots of improvements in SQL dashboards that let you view top
executions of SQL statements or aggregated metrics and integrate with InfoSphere Optim Query Workload Tuner 3.1 just released in October.
- Many new reports are available. My favorite is the SQL comparison report that makes it easy
to find SQL performance improvements or regressions before and after
- Dashboards now have enhanced analysis for
database partitions and DB2 pureScale members.
- With a new best practices template for DB2
Workload Manager configuration, you can get up and running quickly with DB2 Workload Manager for warehouse
For more detailed information, see the information center.
InfoSphere Optim Configuration Manager 2.1 is available for both
DB2 for Linux, UNIX and Windows and DB2 for z/OS environments. It provides centralized
management of database and client configurations to get insight into IT
environments, reduce database outages, and improve compliance to enterprise
standards. Top features enable DBAs and other staff to:
- Discover client information
for databases, such as host name, IP address, user ID, client version
information and track their access to data servers. Get a complete view of database client and DB2 server topology. Check whether your driver upgrade has been completed.
- Redirect clients from one
database to another, one subsystem to another, or one member to another. This centralized management improves DBA control over staged migrations or lets them isolate poorly
behaving applications to mitigate impact to others..
- Define and enforce official
connection definitions to support workload balancing and workload
management objectives. A disconnect between developers (who set connection properties) and DBAs or systems administrators (responsible for workload balancing and resource allocation) makes it hard to get the right level of control. Now you can push down the right properties to enable data sharing or Workload Manager to be more effective in workload balancing and resource allocation.
- Track database and client
configuration changes to help determine the root cause for performance
degradation. InfoSphere Optim Performance Manager also surfaces integration with Configuration Manager so you can see what changed while investigating performance issues.
Check out our Configuration Manager demo that highlights several of the features above. You can read more about InfoSphere Optim Configuration Manager in our announce letters for offerings on Linux, UNIX, and Windows or on z/OS
or in the information center.
If you have any feedback, please post here or to our Performance Management forum.
Holly Hayes, Optim Tools Product Manager
I've been a development manager on database administration capabilities for Data Studio for many years, and recently took over as product manager, as well. I am very excited about our new Data Studio 3.1 release. It not only includes enhancements to the previous release of Data Studio, but, more importantly, combines the feature set of Optim Database Administrator and Optim Development Studio with Data Studio and Data Studio Health Monitor to create one comprehensive product for application development and database administration, all available at no charge! Data Studio can be found as a download from developerWorks
and soon will be bundled with a number of IBM data servers such as DB2 for Linux, Unix and Windows, DB2 Connect and IBM Informix.
Data Studio 3.1 now consists of three components:
Data Studio administration client: Reduced footprint client for administration and non-Java based development. (You may remember we referred to this previously as the stand-alone package)
Data Studio full client: Full-feature client that can shell-share with other Eclipse-based products (This was previously called the integrated development environment package) .
Data Studio web console: health monitoring and new job scheduling capability (this was formerly known as Data Studio Health Monitor)
In addition to the consolidation, we've enhanced the following areas:
The object management feature has been completely overhauled. The new UI provides for in place editing of objects and eliminates the need for a separate editor. Complex object management for Optim Database Administrator for DB2 for Linux, Unix and Windows has been incorporated into the new object management for Data Studio 3.1.
There are a number of enhancements related to navigating, monitoring and managing a DB2 pureScale environment.
There are numerous enhancements to the query editor. They include version specific validation, execution control and special register support.
You can now change the user name and password on any or all connections with one action. The Data Studio web console also provides a central place to define database connections that can be imported by the Data Studio full or admin clients.
Compare and Sync
There are enhancements to reporting and visualizing changes.
DB2 for z/OS
We added support for temporal tables and query tuning now includes set/update profile support for runstats and table data sampling
Scripts may be scheduled as jdbc or clp scripts for DB2 for Linux, Unix and Windows and jdbc scripts for DB2 for z/OS.
You can find current Data Studio product information here
. Check out and post questions, comments, or requests on our forum
or visit our information center
and information roadmap.
P.S: Today we also announced the following:InfoSphere Data Architect 7.6 InfoSphere Optim pureQuery Runtime z/OS 3.1InfoSphere Optim pureQuery Runtime LUW 3.1InfoSphere Optim Query Workload Tuner LUW 3.1 InfoSphere Optim Query Workload Tuner z/OS 3.1
We released several fix packs on June 30th and a modification release on July 1. There are a few new features and platform support worth taking time to highlight.
Optim Performance Manager – Optim Performance Manager 4.1.1 is now available. We put a lot of focus on up-and-running improvements in this release. This includes embedding a lightweight web container to simplify installation, configuration, and security, simplifying our port infrastructure for Extended Insight support, improving the out-of-the-box monitoring templates based on customer experience and more. We have added pureScale-specific monitoring enhancements including pureScale monitoring templates, group buffer pool hit ratios, cluster facility lock wait time, escalations, timeouts, etc. We provided more flexibility for monitoring large DPF environments by separating collection intervals for bufferpool versus tablespace and table statistics, which provides more comprehensive information at a lower cost. We have also included DB2 Enterprise Server Edition 9.7 for use with Optim Performance Manager. For the complete list of features and more information, see the IBM Optim Performance Manager 4.1.1 release notes.
Optim Development Studio – Optim Development Studio 18.104.22.168 now also officially supports deployment on Citrix (I know several organizations that went ahead and deployed before our formal support was announced). It also includes two very cool items:
- Integration with Optim Performance Manager – Now you can pull performance metrics into Optim Development Studio to assist in determining which SQL statements need a little more tuning and whether your tuning efforts are paying off. This integration requires Optim Performance Manager Extended Edition with Extended Insight monitoring configured.
- Support for Sybase - You can connect to a Sybase database and browse catalogs, manage objects, create and run SQL scripts, and create, deploy, run, and debug stored procedures. Plus you can use the ANTs Software product IBM® DB2 SSacSA to connect to a DB2 for Linux, UNIX, and Windows database as a Sybase database.
Remember, Optim Development Studio is available on Passport Advantage to most DB2 and Informix customers as part of their DB2 for Linux, UNIX, and Windows, DB2 Connect, or Informix investment. Find it in the Linux or Windows eAssemblies. See IBM Optim Development Studio Version 22.214.171.124 Release Notes
for a more information and download updates from Fix Central
Optim Database Administrator - Optim Database Administrator 126.96.36.199 also adds official support for Citrix deployment. It also sports a new table data editor for DB2 for LUW and z/OS databases and closed a couple gaps in the dependency analysis space for packages and procedures. It also includes catalog filtering improvements tailored to very large databases. Optim Database Administrator is available to DB2 for Linux, UNIX, and Windows customers as part of their DB2 9.7 Linux or Windows eAssembles on Passport Advantage. See IBM Optim Database Administrator Version 188.8.131.52 Release Notes for more information and download updates from Fix Central.
Data Studio – Data Studio 184.108.40.206, both stand-alone and IDE, inherit the Optim Database Administrator Citrix, table data editor, dependency analysis, and catalog filtering enhancements. In addition, this release includes some enhancements specifically for DB2 for z/OS, notably use of TABLESAMPLE keyword on statistics recommendations and catalog navigation performance improvements. For more information, see the IBM Data Studio Version 220.127.116.11 Release Notes. Download updates from Fix Central or a fresh install at developerWorks.
Check them out and post questions, comments, or requests here or on our forums
We released several fixpacks on April 19th that I want to call your attention to. Not only do they provide defect fixes, but also some cool new function.Data Studio Health Monitor
- This fixpack adds support for health monitoring for DB2 for z/OS as well as alert notification support. Customers that we previewed the function with really liked the easy setup and the ability to share it with teams members in development and other operations staff. It monitors and alerts application blocking conditions like database down or log full plus users can view system log messages and see what application and utilities are running. Data Studio Health Monitoring is available at no charge and support DB2 for z/OS and DB2 for Linux, UNIX, and Windows databases. Check it out now! For more information, see the IBM Data Studio Health Monitor Version 18.104.22.168 Release Notes
and product overview
pages. You can download Data Studio Health Monitor V22.214.171.124 for an upgrade from version 2.2.1 or for a fresh install at IBM software downloads
.Optim Query Tuner
- Query Tuner users will definitely want to pick this up! This fixpack for Optim Query Tuner offerings provides a new Access Plan Explorer. Many customers who have very complex SQL wanted a textual access plan navigation method in additional to the visual explain. This new tool displays access plans as tables or hierarchical trees. There are also additional usability and SQL capture enhancements. See What's New in Optim Query Tuner
and the Release Notes
pages.InfoSphere Data Architect
- This is a standard fixpack with defect fixes. For more information, see the IBM InfoSphere Data Architect Version 126.96.36.199 Release Notes
and product overview
pages. View the download document
to learn how to download InfoSphere Data Architect V188.8.131.52 to upgrade from version 7.5.3.
Let us know how you like these enhancements :-)
Big news last week on the Optim tools front.
- DB2 introduced a new server, Advanced Enterprise Server Edition, that bundles up tons of tools for a phenomenal value, including Optim Performance Manager! Anyone looking at or owning Enterprise Server Edition needs to take a look at this high value offering. See the announcement here.
- All DB2 for Linux, Unix, and Windows customers with current subscriptions now get access to Optim Database Administrator and Optim Development Studio in addition to Data Studio. Use Optim Database Administrator to save time and reduce errors in administering DB2 databases. Use Optim Development Studio to accelerate application development against DB2 and Oracle. Let the downloading begin! (Links further down)
- We released mod releases and fixpacks today for several tools with great added function with more coming later in the month.
Let me take you through the highlights.
Administration and Availability
- Data Studio provides an easy to use development and administration tool. Data Studio 2.2.1, still available in either a standalone or integrated development environment (IDE) configuration, is enhanced for first time user experience, customizable catalog navigation, customizable, template-based routine development (check out the new article from Michael on this), enhanced data browsing, a new query tuning UI, a new health monitor, and updates for use with DB2 for z/OS V10. Early user feedback has given rave reviews to the new task launcher for improving the experience for first-time users, particularly those not familiar with the Eclipse environment. The new health monitor is a separately installed component with Web UI, but is seamlessly launchable from the Eclipse client to monitor DB2 for Linux, UNIX, and Windows health and view alerts, application, utilities, and storage. Download it here.
- Optim Database Administrator saves time and reduces errors associated with complex database changes for DB2 for Linux, UNIX, and Windows databases. Installable together with the Data Studio IDE, it provides copy and paste, compare and synch, and data migration features that identify and manage dependent objects automatically. It provides seamless integration with InfoSphere Data Architect for governing and accelerating the database design through deployment process. Optim Database Administrator 2.2.3 inherits most of the Data Studio enhancements and enhances compare filtering. It also improves performance for building change scripts when working with a small number of objects in very large databases. Use with Optim Test Data Management to streamline test data creation, reduce storage consumption, and manage data privacy. Download Optim Database Administrator 2.2.3 here.
- Optim High Performance Unload reduces demand on system resources, shrinks batch window requirements, accelerates database migrations, and minimizes impact on business operations by speeding up unload processes by 4X or more. Optim High Performance Unload 4.2 is enhanced with DB2 pureScale support and a new option for unloading from a schema.
Design and Development
- InfoSphere Data Architect enhances design productivity, data quality, enterprise consistency and data governance. It supports business and IT collaboration to keep IT aligned with business objectives and helps to define and enforce compliance to enterprise standards. New in InfoSphere Data Architect 7.5.3 is enhanced multi-dimensional modeling including automatic discovery and notation of facts, measures, dimensions, and outriggers, automatic de-normalization of operational data for designing warehouses, and lossless integration with InfoSphere Warehouse and Cognos Framework Manager. Watch for a demo of this new capability later this month. Download InfoSphere Data Architect 7.5.3 here.
- Optim Development Studio increases development efficiency up to 50% for Java data access and facilitates cross-system development and migration. A quick review: it supports development for DB2, Oracle, and Informix. Its SQL outline feature facilitates developer and DBA collaboration quickly isolating all the SQL for review and enabling impact analysis by correlating SQL with source code, database objects, and ALTER requests. Its application metadata can be transferred to Optim Performance Manager to pinpoint problem SQL to the Java method and line of code. Plus it positions the organization to take advantage of Optim pureQuery Runtime to enhance and lockdown performance and mitigate SQL injection risk. New in Optim Development Studio 2.2.1 is the ability to deploy SQL scripts, procedures, and functions to multiple development and test servers with a single gesture. The customer feedback has been fabulous. Clifford will have an article coming out in a couple weeks. Included with Optim Development Studio are development-only copies of Optim pureQuery Runtime and the DB2 Connect JDBC driver, so download all of these together from here.
- Optim Performance Manager provides out-of-the-box performance monitoring and management to improve quality of service and prevent impacts to business operations. Its intuitive web UI provides use-anywhere monitoring, alerting, and diagnosis of potential performance bottlenecks. Integrated tooling enables easy setup exploitation of DB2 workload manager to make sure that system database resources are applied according to business priorities. And its performance warehouse provides needed context for proactive performance management, trend analysis, and capacity planning. The new Optim Performance Manager fix pack (timed for delivery with DB2 Advanced Enterprise Server Edition) does double-duty providing health monitoring for all your other development and test systems at no additional charge providing a single integrated console for monitoring all your DB2 servers. Plus it has added more flexibility in alert management, DB2 Workload Manager configuration, more performance metrics, more reports, and more consumability improvements. Want more? Upgrade to Optim Performance Manager Enterprise Edition. It enables monitoring of end-to-end database transaction times to assure that critical workloads are meeting their response time targets. New in this delivery, tell us the response time goal for the workload and let us figure out how to make it happen. Plus there’s now support for .NET and Type 2 connection workloads, enhanced Tivoli integration, and more granular performance detail.
- Optim Query Tuner gives DBAs and developers expert advice on query structure, access paths, statistics, and indexes to improve query performance. Optim Query Tuner for Linux, UNIX, and Windows 2.2.1 sports a new user interface to streamline query tuning workflow.
- Optim pureQuery Runtime improves performance and predictability while reducing risk. Optim pureQuery Runtime 2.2.1 adds support for ODBC and CLI applications. Using pureQuery, you can configure a DB2 application to run the application's dynamic SQL statements statically. You can also convert SQL statement string literals to parameter markers to improve performance, replace poor performing SQL statements with optimized statements without changing the application, and reduce the risk of SQL injection attacks by restricting what SQL statement are allowed to run against the database.
OK, let me take a breath! As you can see, we’ve been busy. Hope you’re planning to stop in and see us in Las Vegas at the Information On Demand conference. Kimberly will post a summary of our key sessions and events soon.
We recently uploaded Fix Packs for many of our products. The major theme for these Fix Packs is support for Windows 7. Here are the product Fix Packs that include the Windows 7 support with links to the appropriate download documentation.
You may notice that High Performance Unload is not in that list. I will post again when that fix pack is ready.
Remember, you can find help from volunteers and other users at discussion forums that are available for all of these products. See the Integrated Data Management community space for links to all discussion forums on developerWorks.
Hey, DB2 for Linux, UNIX, and Windows DBAs! We’ve enhanced the Optim Database Management Professional Edition
with new editions of:
If you missed the summer announcement, this solution combines database administration, change management, performance monitoring, and high-speed unload capabilities into a conveniently packaged and attractively priced solution. Manas blogged
about the new release of Optim High Performance Unload 4.1.2, which includes extended offline capabilities to help you reduce the risk of business disruption. Check out the full announcement here
Optim Database Administrator V2.2.2 helps prevent errors and data loss when upgrading databases to support new applications. It helps you:
- Automate and script structural database changes
- Perform extended alters that require dropping and re-creating tables and managing data preservation
- Perform schema compare and synchronization with custom mapping features
- Migrate database objects, data, and privileges and generate maintenance utility commands
- Manage database objects, privileges, and utilities with an embedded components of Data Studio software
New and enhanced capabilities in Version 2.2.2 improve overall administrative tasks by supporting federated objects, enable off-peak task scheduling providing the ability to produce scripts that can run with the DB2 command line processor, add basic pureScale support, and improve analysis performance for large DB2 environments (think 1000s of tables). The announcement letter is here
I’m very excited about our recent announcements as they really feature our drive to deliver on the Integrated Data Management vision with key enhancements in heterogeneity support, cross-lifecycle integration, and automated delivery of best practices. But maybe you’re wondering about what we mean by Integrated Data Management
Organizations often have a myriad of tools from many vendors designed to increase productivity and effectiveness of the application development, data management, and administration staff. Most tools are built to purpose and put little emphasis on leveraging information gleaned from the others. We think that this lack of cohesion results in increased costs and increased risks. For example, how do you align an organization around compliance requirements? A security analyst needs to specify privacy requirements, a developer needs to analyze how they manipulate sensitive data in their application, a tester needs to fictionalize data for use outside production, a DBA needs to encrypt databases hosting sensitive data in production. Or in another example, how does the administration staff isolate problems across interacting components, associate problematic SQL with an issuing application, identify source application code or responsible developer?
To a large extent Integrated Data Management is about delivering capability to enable alignment, productivity and performance. It is about enabling alignment across the data lifecycle based on policies defined up front that are shared and enabled with downstream tasks. It is about improving not only individual productivity, but also organizational productivity supporting tasks across heterogeneous environments, increasing automation, and facilitating collaboration. And it is about optimizing performance and resource utilization embedding best practices and industry or application expertise into solutions. These capabilities are key enablers for accelerating business growth, reducing infrastructure costs, and enabling data governance. I’ve elaborated on our vision in Integrated Data Management: Managing data across its lifecycle
on its third revision on developerWorks.
Our most recent announcement extends our support for Oracle environments. You can read about the new Optim Development Studio support for Oracle in Venkatesh’s blog entry
. This complements the Oracle support already available for data design, test data management, and data archival capabilities. New portfolio integration points feature privacy management throughout the development cycle specifying privacy policies in InfoSphere Data Architect,
visualizing sensitive data and actions against it in Optim Development Studio
, generating test data definitions in either Data Architect or Development Studio for execution with Optim Test Data Management
and Data Privacy
solutions. I’m sure a blog entry is coming on this soon. And our new Optim Query Tuner
takes best practices and delivers it as expert tuning advice to developers or DBAs for tuning queries.
I’d be interested in knowing if this vision for Integrated Data Management resonates with you and your organization. As you think about how your various roles have to interact, what linkages could we enable that would provide the most value to your organization?
I was looking at Scott Ambler’s surveys
on IT project success rate. It is very interesting how project success as seen through Scott’s surveys present a more hopeful picture for project success than from the Standish Group’s Chaos Report
, which in its 2006 refresh reported a 35% success rate and a 46% “challenged” rate. (Nice blog entry summarizing a variety of research on the topic in Dan Galorath’s blog
and 2006 Standish numbers from an SD Times article
.) Standish defined success as “on time, on budget, meeting the spec”, while challenged means they had cost or time overruns or didn’t fully meet the user’s needs. But I digress…
Scott’s data indicates that projects that use evolutionary development methodologies, e.g. Agile
or Rational Unified Process
, fare better than those using traditional waterfall or ad-hoc processes. That’s not surprising given the emphasis on tight collaboration among stakeholders and continuous evolution and validation. Really, it’s pretty intuitive. So I was thinking about key characteristics of iterative methodologies and how they relate to database and data access development. (I know, Scott has already thought about this too.
See his Agile Data
site. And Rafael did a Webcast
on it earlier in the year.) But more specifically, I wanted to look at how our Data Studio portfolio supports evolutionary development methodologies. Yes, there’s more to do, but I think what we offer goes a long way towards accelerating solution delivery with high quality results. Vijay and I are going to do a Webcast on this April 28th titled Accelerating Solution Delivery for Data-Driven Applications
. Hope you’ll join us.
In some ways, this is also the companion Webcast to Rafael’s Performance Optimization
webcast. In his blog
, he talked about how from a lifecycle perspective performance optimization can broken down into doing it right the first time or fixing it after that fact. His Webcast focused on the latter and this one on the former.
What are your stories about evolutionary methodologies and database development? Have you used Data Studio software in this context?
In these trying economic times, we have to find ways to reduce costs everywhere we can. And if you can reduce costs while at the same time improving staff productivity, well, that looks pretty good.
For organizations running WebSphere and DB2 applications on z/OS, and there are quite a few, we think we have just that opportunity in pureQuery software. Stephen Brodsky and others have been writing about the value of pureQuery on this blog
and we published some good numbers on pureQuery performance
as well. In case you prefer listening to reading, I recently recorded a podcast on pureQuery. You can find the podcast on iTunes by searching the podcast directory for “Did you say mainframe?" which will bring up the Did you say mainframe? category. My podcast is the one entitled "Enhancing Java environments with pureQuery."
Also, Stephen and I are doing a webcast together on February 4th focused on pureQuery in the mainframe environment. You can register here
. I hope you’ll join us and that this creates an opportunity for your organization to save money.
Hi, I'm a Program Director with IBM Data Studio software. I've had a long history with IBM and, in particular, database and database tools spanning DB2 for z/OS, data replication, business intelligence, information integration, and database management tools.
I recently attended the CIO Forum
in Pittsburgh, Pennsylvania. The CIO Forum is a 2 day regional event held in various cities across the United States focused on developing executive IT leadership, networking with peers, and leveraging technology to succeed in the global economy. There were around one hundred attendees which made it a great size for interacting.
A few of things stand out for me:
First, of course, our panel on Integrated Data Management with Deborah Hurley, Chief Warehouse Architect for Constant Contact, and Joe Farrugia, VP of Sales and Consulting for Dynamic Systems Solutions. Deborah is leading the way towards effective alignment of business and IT at Constant Contact. Using Rational Data Architect
, IBM InfoSphere Information Server
, and Business Glossary
together, Constant Contact is driving ownership of the glossary terms with the subject matter experts in the line of business, but keeping IT in synch through integrations with Rational Data Architect and Information Server. Linking business and IT is key to developing trusted information assets, and business analysts are going to be front and center in this evolution.
The increasing importance of the business analyst role was also echoed in an analyst research note I'd read on the plane on the way to Pittsburgh. And at the event, one of the attendees spoke of their business curriculum that was morphing to focus on developing the cross-business-and-IT skill set needed to perform these emerging roles. Check out Deborah's session at Information on Demand.
Constant Contact Manages Metadata: RDA, Cognos BI, & Information Server
, Thursday, Oct 30 at 8:30 AM.
I'd really like to hear from you... How is your organization managing alignment across business and IT?
The next thing I noticed is the degree of interest in data archiving solutions (even more than data privacy solutions). Our IBM table garnered lots of interest, particularly about our data archiving solutions (or maybe it was the ever-popular THINK ball caps). Folks we spoke to were looking to data archiving to improve performance for both online and batch processing and to retain information off-line for regulatory purposes while providing fast access in case of discovery requirements. They thought IBM Optim
solutions sounded very promising, particularly given their cross-platform, cross-database, and application-aware characteristics. I think Joe Farrugia's description of client successes and savings drew them our way, too. If this is an area of interest to you, too, you might want to check out another session at IOD:
Mid-American Energy: DB2 Archiving for Performance and Cost Control,
Wednesday, Oct 29th at 11:30 AM. Are archiving or data privacy top issues for your organization? What are your key business drivers?
I'm really interested in hearing from you all about issues around business and IT. It's always good to be able to feed real scenarios back to our engineering teams to ensure that we hit the mark. Feel free to comment using the Comment link below, or send an email to email@example.com and tell us your story!