The fastest storage for the fastest system: Summit

Share this post:

This week in Frankfurt, Summit was crowned the “Fastest System in the World” in the biannual Top500 survey. The ORNL system is the most powerful, with over 200 petaflops of NVIDIA and IBM Power Systems compute, but it is much more.

This is no ordinary system. It is purpose-built to use GPUs and excel on artificial intelligence (AI) workloads. AI differs from traditional high-performance computing (HPC) workloads. The majority of HPC is devoted to using computers to simulate the real world using mathematical models. There are many import applications, from drug development to weather predictions.

In contrast, AI programs are trained on historical data and predict new results as data comes in. In most cases, the data is unstructured, dense and diverse. These can consist of images, files, documents and datasets. Already a leader in data throughput, scalability and latency, IBM Spectrum Scale has been developed to deliver a file system for the fastest supercomputer in the world — one that was purpose-built for AI workloads with over 12,000 NVIDIA GPUs.

The aggregate numbers are staggering. Summit’s 250-petabyte storage system is delivered by a cluster of 77 IBM ESS Storage Systems that will deliver 2.5 TBs of data. But the real work has been on small file performance, where IBM Spectrum Scale has a 700 percent improvement in small file reads compared to our 4.2.2 version. Summit will have the capacity of 30B files and 30B directories and will be able create files at a rate of over 2.6 million I/O file operations per second. That is opening every book in the US Library of Congress in 10 seconds.

As impressive as these numbers are, it is really the impact these innovations can have for our clients, regardless of their size, that matters.  Whether it is the throughput required for a cluster of SAP HANA systems or GPUs, extreme low latency on NVMe all-flash, fast metadata search across billions of files, media serving or small file performance, the same IBM Spectrum Scale software that is driving Summit is available for you.

To read more about the Summit performance numbers read Ray Lucchessi’s analysis here.

Portfolio Manager, Spectrum Scale

More Storage stories

Make private cloud your competitive differentiator

When I think about cloud technology, I tend to put customers into 3 buckets. Companies which have embraced the cloud Companies in the planning stages of embracing the cloud Companies whose leaders are thinking about how the cloud is going to help them deliver their business outcomes The reality is that the cloud is here, […]

Continue reading

Guard your virtual environment with IBM Spectrum Protect Plus

The server virtualization market is expected to grow to approximately 8 billion dollars by 2023. This would mean a compound annual growth rate (CAGR) of 7 percent between 2017 and 2023. Protection of these virtual environments is therefore a significant and critical component of an organization’s data protection strategy. This growth in virtual environments necessitates […]

Continue reading

VUmc creates data storage platform for vital research

When VU Medical Center (VUmc) in Amsterdam started to reevaluate their data strategy and data architecture capabilities, they realized they have a significant gap to bridge between where they are and where they want to be. The fact that they have massive amounts of data that needs to be kept for decades (including administrative documents, […]

Continue reading