Skip to main content

By clicking Submit, you agree to the developerWorks terms of use.

The first time you sign into developerWorks, a profile is created for you. Select information in your developerWorks profile is displayed to the public, but you may edit the information at any time. Your first name, last name (unless you choose to hide them), and display name will accompany the content that you post.

All information submitted is secure.

  • Close [x]

The first time you sign in to developerWorks, a profile is created for you, so you need to choose a display name. Your display name accompanies the content you post on developerworks.

Please choose a display name between 3-31 characters. Your display name must be unique in the developerWorks community and should not be your email address for privacy reasons.

By clicking Submit, you agree to the developerWorks terms of use.

All information submitted is secure.

  • Close [x]

System z Rocks (Again)

The mainframe isn't dead-in fact, it's turning heads as a data warehouse platform

Robert Catterall (rfcatter@us.ibm.com), IBM DB2 Specialist, IBM
Robert Catterall is an IBM DB2 specialist.

Summary:  Why IBM System z and DB2 are not only a popular combination for BI, but the primo platform for data warehousing

Date:  12 Oct 2009
Level:  Introductory

Activity:  2364 views
Comments:  

When IBM announced DB2 in 1983, the product was mainframe-based and positioned as a new technology foundation for decision-support applications (the term "data warehouse" had not been coined yet). Organizations jumped on DB2, but often used it to run online transaction processing (OLTP) workloads. In response, IBM added lots of performance-enhancing features to DB2, and OLTP became the primary workload running on DB2 systems all over the world.

As time went by, the predominance of OLTP fed a perception that mainframes were not a great fit for business intelligence (BI) applications. Now, however, IBM System z and DB2 are a popular combination for BI. How is it that DB2 and the mainframe-the combination born for BI-are once more seen as a primo platform for data warehousing?

The mainframe market: Very healthy, thank you

The "mainframes are dead" pronouncements reached a crescendo in the late 1990s, and some folks continue to stick to that line. What a load of bunk. The market for IBM mainframe servers remains very robust (see sidebar, "Mainframes still in the mainstream").

In fact, the System z server line is thriving because it solves major challenges that almost every company is facing, starting with the drive toward "greener" computing. System z servers are highly space- and energy-efficient, delivering a lot of computing power per unit of floor space occupied and unit of energy consumed.

Another mainframe-boosting trend is the desire for continuous availability and consistently good performance of online applications, underscored by users' trust that sensitive data will be well protected. System z has long been the benchmark computing platform when it comes to availability, scalability, workload management, and security (advantages that are even more pronounced when several IBM z/OS systems work together in a shared-data, Parallel Sysplex cluster).

Just because mainframes are hot technology doesn't mean that z-based data warehousing should be on the rise-but that's what's happening. Why? For one thing, there is an increasing interest in getting more BI work done closer to the warehouse source data, and a great deal of that source data is on mainframe systems. Getting the data warehouse close to the data supply facilitates frequent, near-real-time updating of warehouse data, a huge plus for many organizations.

Further, many companies now see their data warehouse systems to be just as mission critical as their run-the-business OLTP applications. Tolerance for unscheduled outages is low, especially when failures trigger financial penalties built into service-level agreements. That often leads organizations to build their warehouse on a System z foundation.


DB2 for z/OS steps up

While DB2 debuted on the mainframe platform as a DBMS designed for decision support, DB2 for Linux, UNIX, and Windows (LUW) delivered BI-friendly features that were lacking in DB2 for z/OS. This gave some folks the impression that IBM was pushing distributed system servers as the DB2 platform of choice for data warehouse applications.

In recent years, DB2 for z/OS got its BI groove back, thanks to enhancements in DB2 8 and 9, including:

64-bit addressing (DB2 8): Data warehouse applications are often I/O-intensive, and it helps to be able to allocate really big buffer pools.

Materialized query tables (DB2 8): By providing prebuilt intermediate result sets that would otherwise have to be materialized at query execution time (often related to aggregation functions or table join operations), MQTs can dramatically reduce query run times.

In-memory work files (DB2 8, extended in DB2 9): When an intermediate result set is materialized at query execution time and is subsequently re-accessed by DB2, that re-access is accelerated through the use of in-memory work files.

Indexes on expressions (DB2 9): BI queries are often complex and regularly involve predicates that contain column expressions. The ability to create indexes on column expressions can deliver orders-of magnitude performance improvements.

Index compression (DB2 9): In data warehouse environments, the disk space used for indexes can exceed the space used for tables. Index compression can help reduce index disk space consumption significantly.

Richer SQL: Includes common table expressions and recursive SQL (DB2 9); INTERSECT and EXCEPT for result set comparison (DB2 9); online analytical processing (OLAP) functions such as RANK, DENSE_RANK, and ROW_NUMBER (DB2 9); TRUNCATE for quickly emptying data from a table (DB2 9).


Add some financial incentives

A BI application can be a particularly costeffective mainframe workload, thanks to a couple of financial incentives provided by IBM:

zIIP engines: System z Integrated Information Processors (zIIPs) are specialized mainframe CPUs that help lower the cost of computing: they cost less than generalpurpose processors, and they do not factor into mainframe software pricing. DB2 query parallelism-a big performance booster for data warehouse queries-is a zIIP-eligible system activity. zIIPs can also handle some of the work associated with queries that get to DB2 by way of the Distributed Data Facility, using the Distributed Relational Database Architecture (DRDA) protocol (often through IBM DB2 Connect)-something that's very common in DB2-based data warehouse environments.

DB2 for z/OS Value Unit Edition pricing: For certain types of application workloads (and data warehousing is one of the eligible types), DB2 for z/OS can be acquired for a one-time charge.

A green, super-scalable, super-available, and super-secure server platform. Advanced BI technology. Budget-friendly financial incentives. DB2 and System z offer a compelling solution for organizations seeking a rock-solid foundation on which to build mission-critical data warehouses. How to get from A to B, then? That's where IBM InfoSphere can help.


InfoSphere: Design, populate, accelerate

A data warehouse does your organization good when it is populated and providing actionable information to users. IBM InfoSphere Warehouse on System z provides an integrated toolset that helps you get there faster, particularly when the warehouse source data is managed by DB2 for z/OS. The toolset includes a Design Studio that helps to model data for OLAP access (including physical database design and data movement flows); the SQL Warehousing Tool (SQW), which delivers a SQL-based data movement and transformation capability; Cubing Services for optimizing multidimensional reporting and analysis, including a caching capability that can greatly improve performance for queries expressed in the industry-standard Multidimensional Expressions (MDX) query language and that supports popular enduser tools such as IBM Cognos 8 Business Intelligence and Microsoft Excel; and an administration console to manage the runtime environment.

So, get with the in crowd. The mainframe platform that runs your mission-critical OLTP applications is also a great choice for data warehousing. After all, BI is in the DNA of DB2 for z/OS.


About the author

Robert Catterall is an IBM DB2 specialist.

Report abuse help

Report abuse

Thank you. This entry has been flagged for moderator attention.


Report abuse help

Report abuse

Report abuse submission failed. Please try again later.


developerWorks: Sign in


Need an IBM ID?
Forgot your IBM ID?


Forgot your password?
Change your password

By clicking Submit, you agree to the developerWorks terms of use.

 


The first time you sign into developerWorks, a profile is created for you. Select information in your developerWorks profile is displayed to the public, but you may edit the information at any time. Your first name, last name (unless you choose to hide them), and display name will accompany the content that you post.

Choose your display name

The first time you sign in to developerWorks, a profile is created for you, so you need to choose a display name. Your display name accompanies the content you post on developerWorks.

Please choose a display name between 3-31 characters. Your display name must be unique in the developerWorks community and should not be your email address for privacy reasons.

(Must be between 3 – 31 characters.)

By clicking Submit, you agree to the developerWorks terms of use.

 


Rate this article

Comments

Help: Update or add to My dW interests

What's this?

This little timesaver lets you update your My developerWorks profile with just one click! The general subject of this content (AIX and UNIX, Information Management, Lotus, Rational, Tivoli, WebSphere, Java, Linux, Open source, SOA and Web services, Web development, or XML) will be added to the interests section of your profile, if it's not there already. You only need to be logged in to My developerWorks.

And what's the point of adding your interests to your profile? That's how you find other users with the same interests as yours, and see what they're reading and contributing to the community. Your interests also help us recommend relevant developerWorks content to you.

View your My developerWorks profile

Return from help

Help: Remove from My dW interests

What's this?

Removing this interest does not alter your profile, but rather removes this piece of content from a list of all content for which you've indicated interest. In a future enhancement to My developerWorks, you'll be able to see a record of that content.

View your My developerWorks profile

Return from help

static.content.url=http://www.ibm.com/developerworks/js/artrating/
SITE_ID=1
Zone=Information Management
ArticleID=435089
ArticleTitle=System z Rocks (Again)
publish-date=10122009

Tags

Help
Use the search field to find all types of content in My developerWorks with that tag.

Use the slider bar to see more or fewer tags.

For articles in technology zones (such as Java technology, Linux, Open source, XML), Popular tags shows the top tags for all technology zones. For articles in product zones (such as Info Mgmt, Rational, WebSphere), Popular tags shows the top tags for just that product zone.

For articles in technology zones (such as Java technology, Linux, Open source, XML), My tags shows your tags for all technology zones. For articles in product zones (such as Info Mgmt, Rational, WebSphere), My tags shows your tags for just that product zone.

Use the search field to find all types of content in My developerWorks with that tag. Popular tags shows the top tags for this particular content zone (for example, Java technology, Linux, WebSphere). My tags shows your tags for this particular content zone (for example, Java technology, Linux, WebSphere).

Special offers