Storage

Hybrid cloud, GPUs and containers….as easy as 1,2,3

Share this post:

Among organizational leaders operating high-performance computing environments today, there is rapidly growing interest in being able to leverage cloud computing resources on demand to augment on-premises resources – to address peaks in demand or to ensure time-critical work can be completed on time.  With more than two decades of experience managing clusters and clouds, we are pleased to announce the release of the third update to IBM Spectrum LSF 10, featuring updates in three main areas which make it easier to gain the benefit of a hybrid cloud approach:

  • We’ve made hybrid cloud even easier by further enhancing the IBM Spectrum LSF resource connector capability, which provides autoscaling in the cloud. New bursting policies, along with support for spot pricing and federated identities, provides administrators with even greater control in how cloud resources are provisioned to meet business service-level agreements (SLAs).   In addition to Amazon EC2, support for IBM Bluemix and Microsoft Azure have also been added.
  • Support for graphics processing units (GPUs) in IBM Spectrum LSF was first added in 2009. Back then the management capabilities of GPUs were simplistic, as were the use cases.  Over the years, the usage of GPUs to accelerate high-performance computing workloads has grown dramatically, and we’ve continued to evolve our support for them.   In the last year, there has been a huge focus on GPUs for AI.  In this update to IBM Spectrum LSF, we have further evolved our GPU support to provide users with even greater control of how GPUs are used with their applications.
  • The previous update to IBM Spectrum LSF 10 focused on simplifying the use of container environments with IBM Spectrum LSF. In this update, we have added support for NVIDIA Docker. Administrators are now allowed to dynamically insert site-specific options into the container start up sequence.  For example, based on the user and job attributes, specific file systems can be mounted within the container.

Together, these three capabilities make IBM Spectrum LSF 10 an ideal platform for supporting a diverse range of workloads – from traditional HPC and high-throughput workloads, to big data (Hadoop, Spark), machine learning and deep learning (TensorFlow, Caffe) whether on bare metal, virtual environments or containers.

lsf multicluster visual, Hybrid Cloud Storage

Of course, there is a lot more to IBM Spectrum LSF V10.1.0.3 than just these three capabilities.  Find out more about IBM Spectrum LSF here.

New to workload management?  Learn about how the powerful cluster virtualization capabilities of IBM Spectrum Computing products can help to optimize the performance and cost efficiency of your infrastructure while simplifying management.

More Storage stories

Powerful new storage for your mission-critical hybrid multicloud

Flash storage, Multicloud, Storage

Cloud computing and mainframes processors are two of the most important contributors in information technology solutions. They are increasingly being linked together to unlock value for clients. 85 percent of companies are already operating in multicloud and by 2021, most existing apps will have migrated to the cloud. [1] At the same time, mainframe utilization ...read more


A conversation about metadata management featuring Forrester Analyst Michele Goetz

AI, Big data & analytics, Storage

I recently had an opportunity to speak with Forrester Principal Analyst Michele Goetz following a research study on the subject of metadata management conducted by Forrester Consulting and commissioned by IBM. Michele’s research covers artificial intelligence technologies and consultancies, semantic technology, data management strategy, data governance and data integration, and includes within its scope the ...read more


IBM is transforming data storage for media and entertainment

Data security, Storage, Tape and virtual tape storage

Disruptions in media and entertainment have been occurring at a rapid pace over the past few years and many organizations are still struggling with optimizing their IT infrastructure for new data requirements. With growth in capacity, new larger file formats, keeping more data online for business opportunities, and the growing use of AI, organizations are ...read more