Storage

25 years of HPC innovation – IBM Spectrum LSF 10

Share this post:

Even after 25 years, our high-performance computing (HPC) innovations show no signs of slowing. Following the launch of IBM Spectrum LSF Suites Version 10.2, and our acceptance of the 2017 HPCwire Editors’ Choice award for Best HPC Cluster Solution or Technology, we have released the next update to our core scheduler, IBM Spectrum LSF Version 10.1.0.4.

This update generally delivers the capabilities that are being deployed at Oak Ridge National Lab and Lawrence Livermore National Lab as part of the US Department of Energy’s CORAL program, including support for IBM POWER9-based systems and additional capabilities for managing job reservations.

“We are integrating LSF capabilities with facility awareness to influence scheduling decisions,” says Jim Rogers, Director of Computing and Facilities for the Oak Ridge National Laboratory’s National Center for Computational Sciences. “With the ability to exchange information, we expect increased operational effectiveness.”

In addition to over a dozen customer enhancement requests, this release extends the Spectrum LSF resource connector, which provides intelligent dynamic hybrid cloud capabilities to support Google Compute Engine.  The Spectrum LSF resource connector dynamically provision resources across a variety of cloud providers in response to workloads and return them when no longer required.  The computing cluster grows and shrinks intelligently in response to demand.  Additionally, Spectrum LSF now leverages Elasticsearch (included with IBM Spectrum LSF Explorer) as a backend data store for job and energy accounting.

Lastly, a preview of an integration between IBM Spectrum LSF and IBM Spectrum Scale is included that provides end-to-end data provenance, allowing a user to look at files and trace them back through multiple jobs. The job output files are automatically tagged with file creation metadata including job details, container info, input files and more. This is important in many industries where repeatability of results is required.  For a closer look at the end-to-end data provenance preview, refer to the following technical article.

Find out more about IBM Spectrum LSF and high-performance computing solutions in this detailed hands-on video series.

More Storage stories

Make private cloud your competitive differentiator

When I think about cloud technology, I tend to put customers into 3 buckets. Companies which have embraced the cloud Companies in the planning stages of embracing the cloud Companies whose leaders are thinking about how the cloud is going to help them deliver their business outcomes The reality is that the cloud is here, […]

Continue reading

Guard your virtual environment with IBM Spectrum Protect Plus

The server virtualization market is expected to grow to approximately 8 billion dollars by 2023. This would mean a compound annual growth rate (CAGR) of 7 percent between 2017 and 2023. Protection of these virtual environments is therefore a significant and critical component of an organization’s data protection strategy. This growth in virtual environments necessitates […]

Continue reading

VUmc creates data storage platform for vital research

When VU Medical Center (VUmc) in Amsterdam started to reevaluate their data strategy and data architecture capabilities, they realized they have a significant gap to bridge between where they are and where they want to be. The fact that they have massive amounts of data that needs to be kept for decades (including administrative documents, […]

Continue reading