Skip to main content

Porting workshop, Part 4: Mersenne-Twister

Comparing random-number generators

John Easton (JKJ@uk.ibm.com), Infrastructure Architect, Emerging Technologies, IBM
John is currently leading a worldwide emerging technologies team within IBM Systems and Technology Group. He has several roles competing for his time, all of which revolve around advising organizations on how best to exploit new technologies. John has been working for IBM for over 20 years in a variety of technical roles. He worked in Distributed Systems Development in Austin before the launch of the RS/6000, and he holds several patents in the areas of security and systems software. Before taking his current role, he was the European technical leader for grid computing.
Ingo Meents (MEENTS@de.ibm.com), Architect for Cell Solutions, Advanced Planning, Simulation, and Optimization, IBM
Ingo Meents joined IBM nine years ago and works currently as an IT Architect in IBM Global Engineering Solutions (GES). His current focus is to provide IBM customers with knowledge of the latest Cell/B.E. software technology by consulting, educating, briefing, and creating solutions for this platform. Before his work on the Cell/B.E. platform, he was lead architect for a modeling, simulation, and production planning solution used by the IBM 300mm semiconductor line in Fishkill. Starting as a research student at IBM, Ingo Meents received his doctor's degree from the University of Clausthal in 2001.
Olaf Stephan (STEPHANO@de.ibm.com), Server Specialist, DB2, Warehousing BI Solutions, IBM
Olaf Stephan joined IBM in 1998 and currently works as an IT Specialist in IBM Global Engineering Solutions (GES). His focus is to provide IBM customers with knowledge of the latest Cell/B.E. software technology by consulting, educating, briefing, and development for this platform. Before his work on the Cell/B.E. platform, he worked in the areas of data management, data warehousing, business intelligence, and data integration. Olaf holds a Masters degree in Electrical Engineering, specializing in Communications Technology, from the University of Applied Sciences, Koblenz, Germany.
Horst Zisgen (horst_zisgen@de.ibm.com), Program Manager Simulation/Operations Research, IBM
Horst has over 10 years of experience in the application of simulation methods and the development of mathematical models in different areas. He is currently leading a development team in IBM Global Engineering Solutions (GES) that is working on a simulation and planning solution used by IBM 300mm manufacturing in Fishkill and by external customers as well. Horst is also the European subject matter expert for the GES supply chain offerings. In addition, Horst regularly gives lectures at universities about simulation and mathematical modeling. Horst is a member of a standardization group for simulation and optimization.
Sei Kato (SEIKATO@jp.ibm.com), Research Staff Member, IBM
Sei Kato is a staff member in IBM Research, Tokyo Research Laboratory. He joined IBM in 2002 after receiving his PhD in Mathematical Science from the University of Tokyo. After joining IBM, Sei has worked on modeling and simulating the performance of Web systems. His is currently working on the acceleration of financial calculations and on large-scale traffic simulations.

Summary:  The seven quick-read parts of this "Porting workshop" series take you on a real-world trip from strategy and planning through workload execution, performance tweaking, optimization, and a solid conclusion. The series describes how to most effectively port compute-intensive applications to the Cell Broadband Engine platform. In this Part 4, the authors explore the Mersenne-Twister random-number generator to determine its effect.

View more content in this series

Date:  18 Sep 2007
Level:  Introductory
Activity:  3523 views

This seven-part, quick-read workshop series is taken from the real-world case study whitepaper, "Porting Financial Markets Applications to the Cell Broadband Engine Architecture" (written by John Easton, Ingo Meents, Olaf Stephan, Horst Zisgen, and Sei Kato, IBM Systems and Technology Group, June 2007; see Resources). You can probably spend less than 10 minutes reading each installment and come out at the end with a strong basic knowledge of the requirements for effectively porting a compute-intensive application (in this case, a financial market application) to the Cell/B.E. processor.

Editor's note: The performance results in this series were obtained using Versions 1 and 2.1 of the Cell Broadband Engine Software Developer Kit (SDK). The current version of the SDK, the IBM Software Development Kit for Multicore Acceleration, Version 3.0, has recently become available and offers many enhancements in functionality, ease of use, and performance over the earlier versions. While the results documented in this article are correct for the earlier versions of the SDK, different results will be obtained with SDK 3.0. Watch for updates to the articles in this series that will describe the latest performance improvements obtained using SDK 3.0.

Workshop series

Part 1: Porting strategies (developerWorks, August 2007)

Part 2: Analysis of the original code (developerWorks, August 2007)

Part 3: Initial performance results (developerWorks, September 2007)

Part 4: Mersenne-Twister (developerWorks, September 2007)

Part 5: Mixed-precision workloads (developerWorks, September 2007)

Part 6: Tying it all together (developerWorks, October 2007)

Part 7: Getting the most performance (developerWorks, November 2007)

Introducing the application

The example application modified in this article is a piece of code used to price a European Option to highlight the benefits of the Cell/B.E. blade. A European Option is a simple financial contract with strict terms and properties that gives the buyer the right to trade a given asset at a specific price on a specific date. It is generally an option that can be exercised only at the end of its life. By contrast, an American Option can be traded at any time between its purchase date and the date at which the contract expires. Because a European Option is traded on a fixed date, it is a simpler calculation to perform because the time variability of the American Option is removed.

You can use several different models price a European Option, depending on the type of asset that underlies it. For example, an option based on currency is calculated using a slightly different model than an option based on futures. In the example described in this series, the calculation is based on a simple Monte Carlo simulation technique. You will generate 200,000,000 uniform, pseudo-random numbers. These numbers are transformed to a log-normal distribution using a Box-Müller transform. Using the random numbers generated, you will execute the financial model repeatedly to simulate a random walk. The final stage of the analysis will be the calculation of the relevant statistics, such as the minimum, maximum, and average and the 95 percent quartile for losses.


Using the Mersenne-Twister

After the initial results from Part 3 of this series, it seemed appropriate to evaluate the potential impact that the choice of random-number generator (from the SDK) might have had on the results. To achieve these results, just add some code to drive work more effectively across the SPUs, and replace the customer-supplied random-number generator with one that has been already optimized for the Cell/B.E. environment and supplied as part of the SDK. No need to make significant changes to the programmatic logic.

Recall that the original customer code uses the Mersenne-Twister random-number generator. Mersenne-Twister comes from the University of Hiroshima. This random-number generator is based on an algorithm that is approximately four times more effective than the random-number generator in the SDK, so it might be interesting to compare the performance of the two algorithms side by side. Here are the results:

  • Run-time with Mersenne-Twister (without optimization): 5 seconds
  • Run-time with the Cell/B.E. SDK: 4.1 seconds

These tests were performed on a 2.4 GHz pre-production Cell/B.E. blade. The interesting observation to make from these results is that the unoptimized Mersenne-Twister random-number generator performs very similarly to the optimized random-number generator from the SDK. Optimizing the Mersenne-Twister code to take advantage of the threading framework and rewriting the code to use the SIMD capabilities of the SPUs should provide a suitable mechanism to improve the performance even more.

Before looking at the porting to Mersenne-Twister of the Cell/B.E. environment, consider some of the issues in generating uniform pseudo-random numbers on the Cell/B.E system:

  • The Cell/B.E. SDK implementation is similar to many C library implementations.
  • The Cell/B.E. SDK implementation uses a scalar linear congruency generator.
  • The Cell/B.E. SDK implementation has been vectorized to handle the generation of four 32-bit random numbers in parallel.
  • As with many implementations of this sort, the code is implemented to deliver one stream of random numbers. Consequently, when the random-number generator is run multiple times in parallel, there is a risk that the subsequently generated streams of random numbers might overlap.

A solution is to create a new implementation of the Mersenne-Twister random-number generator on the Cell/B.E. processor with the appropriate initialization to avoid the potential overlap between the streams of random numbers. You can also implement a vectorized Polar-Transform to get normally distributed random numbers. This implementation delivers a number of performance improvements as expected. Most notably, it was four times faster compared to the Cell/B.E. SDK random-number generator, as shown in Table 5. (Tables and figures are numbered throughout the series to match the versions in the original whitepaper.)


Table 5. Performance comparison between Cell/B.E. SDK and Mersenne-Twister random-number generators
PrecisionRuntime (seconds) SDK RNG (2.4 GHz)Runtime (seconds) Mersenne-Twister RNG (2.4 GHz)Runtime (seconds) Mersenne-Twister RNG 3.2 GHz (estimated)
Single4.11.020.76
Double9.92.471.85

Acknowledgements

Many other individuals contributed (both knowingly and unknowingly) to this piece of work. The authors wish to acknowledge their kind contributions. Without this assistance, this paper would never have been written.


Resources

Learn

Get products and technologies

Discuss

About the authors

John is currently leading a worldwide emerging technologies team within IBM Systems and Technology Group. He has several roles competing for his time, all of which revolve around advising organizations on how best to exploit new technologies. John has been working for IBM for over 20 years in a variety of technical roles. He worked in Distributed Systems Development in Austin before the launch of the RS/6000, and he holds several patents in the areas of security and systems software. Before taking his current role, he was the European technical leader for grid computing.

Ingo Meents joined IBM nine years ago and works currently as an IT Architect in IBM Global Engineering Solutions (GES). His current focus is to provide IBM customers with knowledge of the latest Cell/B.E. software technology by consulting, educating, briefing, and creating solutions for this platform. Before his work on the Cell/B.E. platform, he was lead architect for a modeling, simulation, and production planning solution used by the IBM 300mm semiconductor line in Fishkill. Starting as a research student at IBM, Ingo Meents received his doctor's degree from the University of Clausthal in 2001.

Olaf Stephan joined IBM in 1998 and currently works as an IT Specialist in IBM Global Engineering Solutions (GES). His focus is to provide IBM customers with knowledge of the latest Cell/B.E. software technology by consulting, educating, briefing, and development for this platform. Before his work on the Cell/B.E. platform, he worked in the areas of data management, data warehousing, business intelligence, and data integration. Olaf holds a Masters degree in Electrical Engineering, specializing in Communications Technology, from the University of Applied Sciences, Koblenz, Germany.

Horst has over 10 years of experience in the application of simulation methods and the development of mathematical models in different areas. He is currently leading a development team in IBM Global Engineering Solutions (GES) that is working on a simulation and planning solution used by IBM 300mm manufacturing in Fishkill and by external customers as well. Horst is also the European subject matter expert for the GES supply chain offerings. In addition, Horst regularly gives lectures at universities about simulation and mathematical modeling. Horst is a member of a standardization group for simulation and optimization.

Sei Kato is a staff member in IBM Research, Tokyo Research Laboratory. He joined IBM in 2002 after receiving his PhD in Mathematical Science from the University of Tokyo. After joining IBM, Sei has worked on modeling and simulating the performance of Web systems. His is currently working on the acceleration of financial calculations and on large-scale traffic simulations.

Comments (Undergoing maintenance)



Trademarks  |  My developerWorks terms and conditions

Help: Update or add to My dW interests

What's this?

This little timesaver lets you update your My developerWorks profile with just one click! The general subject of this content (AIX and UNIX, Information Management, Lotus, Rational, Tivoli, WebSphere, Java, Linux, Open source, SOA and Web services, Web development, or XML) will be added to the interests section of your profile, if it's not there already. You only need to be logged in to My developerWorks.

And what's the point of adding your interests to your profile? That's how you find other users with the same interests as yours, and see what they're reading and contributing to the community. Your interests also help us recommend relevant developerWorks content to you.

View your My developerWorks profile

Return from help

Help: Remove from My dW interests

What's this?

Removing this interest does not alter your profile, but rather removes this piece of content from a list of all content for which you've indicated interest. In a future enhancement to My developerWorks, you'll be able to see a record of that content.

View your My developerWorks profile

Return from help

static.content.url=http://www.ibm.com/developerworks/js/artrating/
SITE_ID=1
Zone=Multicore acceleration
ArticleID=255789
ArticleTitle=Porting workshop, Part 4: Mersenne-Twister
publish-date=09182007
author1-email=JKJ@uk.ibm.com
author1-email-cc=
author2-email=MEENTS@de.ibm.com
author2-email-cc=
author3-email=STEPHANO@de.ibm.com
author3-email-cc=
author4-email=horst_zisgen@de.ibm.com
author4-email-cc=
author5-email=SEIKATO@jp.ibm.com
author5-email-cc=

My developerWorks community

Tags

Help
Use the search field to find all types of content in My developerWorks with that tag.

Use the slider bar to see more or fewer tags.

Popular tags shows the top tags for this particular content zone (for example, Java technology, Linux, WebSphere).

My tags shows your tags for this particular content zone (for example, Java technology, Linux, WebSphere).

Use the search field to find all types of content in My developerWorks with that tag. Popular tags shows the top tags for this particular content zone (for example, Java technology, Linux, WebSphere). My tags shows your tags for this particular content zone (for example, Java technology, Linux, WebSphere).

Special offers