Benchmarking and systems performance - hosted by Elisabeth Stahl

Elisabeth Stahl

Blog Authors:  ELISABETH STAHL   is Chief Technical Strategist and Executive IT Specialist, IBM Systems and Technology Group, and has been working in systems performance for over 25 years.

  • Add a Comment
  • Edit
  • More Actions v
  • Quarantine this Entry

Comments (4)

1 localhost commented Trackback

What Hyperbole! IBM hasn't announced 25 #1 benchmarks on Power6 unless you consider the same 4 benchmarks running on different configurations of the same one machine?? Afterall, only the p570 was announced running Power6. I only see SAP, TPC-C, SPECjbb2005 and SPECint/fp results.<div>&nbsp;</div> Plus, TPC-C is now an obsolete benchmark. Its over 14 years old! Why hasn't IBM published TPC-E which has now replaced TPC-C? Why hasn't IBM published TPC-H results if this is such a powerful, high end server? <div>&nbsp;</div> So how much will these faster servers cost? I would think price/performance is a critical measurement. The TPC-C disclosure shows a $2.2M price tag just for the 16-way server with 8 x Power6 chips! What are you kidding? Show us price performance compared to Sun or HP and then we'll believe you.

2 localhost commented Permalink

Phil, Thanks for your comments. It is common practice for all vendors to count benchmark leadership results in this fashion. If you look at the IBM benchmark page you will see that the POWER6 IBM System p 570 leads in SAP, TPC-C, SPECjbb2005, and the SPECcpu2006 portfolio, as well as LINPACK, Oracle Apps, Siebel, Sybase. TPC-C is not considered an "obsolete benchmark." In fact, every client and IT Analyst I talk to asks for this benchmark. You also can clearly see price/performance as it is a required metric for this benchmark. As I always say, be careful what you ask for, with TPC-E as with everything in life.

3 localhost commented Permalink

Interpreting benchmarks or even what benchmarks to look at has always been a dicey proposition. Phil and others might be interested in the following article published by ideas international for a non-IBM view of Power 6 p570 benchmarks: http://ideasint.blogs.com/ideasinsights/2007/05/ibm_uses_system.html<div>&nbsp;</div> I too am interested in seeing other benchmarks posted, like TCP-H. I hope Elisabeth's last sentence is a hint that a TCP-H number will be posted in the future. <div>&nbsp;</div> I was also interested to see the performance improvements being achieved with lower power consumption. In the long run, that may prove to be more important to data center managers than the raw performance.

4 localhost commented Permalink

Saying that Ideas International is an independent source of information is like calling Paris Hilton a paragon of virtue and chastity.<div>&nbsp;</div> IBM just had to cough up enough money, and they would have said that the POWER6 cures cancer...<div>&nbsp;</div> Anonymous

Add a Comment Add a Comment