The fastest storage for the fastest system: Summit

Share this post:

This week in Frankfurt, Summit was crowned the “Fastest System in the World” in the biannual Top500 survey. The ORNL system is the most powerful, with over 200 petaflops of NVIDIA and IBM Power Systems compute, but it is much more.

This is no ordinary system. It is purpose-built to use GPUs and excel on artificial intelligence (AI) workloads. AI differs from traditional high-performance computing (HPC) workloads. The majority of HPC is devoted to using computers to simulate the real world using mathematical models. There are many import applications, from drug development to weather predictions.

In contrast, AI programs are trained on historical data and predict new results as data comes in. In most cases, the data is unstructured, dense and diverse. These can consist of images, files, documents and datasets. Already a leader in data throughput, scalability and latency, IBM Spectrum Scale has been developed to deliver a file system for the fastest supercomputer in the world — one that was purpose-built for AI workloads with over 12,000 NVIDIA GPUs.

The aggregate numbers are staggering. Summit’s 250-petabyte storage system is delivered by a cluster of 77 IBM ESS Storage Systems that will deliver 2.5 TBs of data. But the real work has been on small file performance, where IBM Spectrum Scale has a 700 percent improvement in small file reads compared to our 4.2.2 version. Summit will have the capacity of 30B files and 30B directories and will be able create files at a rate of over 2.6 million I/O file operations per second. That is opening every book in the US Library of Congress in 10 seconds.

As impressive as these numbers are, it is really the impact these innovations can have for our clients, regardless of their size, that matters.  Whether it is the throughput required for a cluster of SAP HANA systems or GPUs, extreme low latency on NVMe all-flash, fast metadata search across billions of files, media serving or small file performance, the same IBM Spectrum Scale software that is driving Summit is available for you.

To read more about the Summit performance numbers read Ray Lucchessi’s analysis here.

Portfolio Manager, Spectrum Scale

More Storage stories

IBM FlashSystem 9100 – The core of the data-driven multi-cloud enterprise

IBM believes that today there is only one kind of successful enterprise – the data-driven multi-cloud organization.[1] We can see the needs of data-driven businesses reflected in some of the most powerful trends currently driving enterprise data storage: Non-Volatile Memory Express (NVMe), artificial intelligence, multi-cloud, containers and more.[2] The question becomes: “Is there a storage […]

Continue reading

IBM Elastic Storage Server adds Storage Utility Offering option

IBM introduces a flexible procurement method that aligns your unstructured data capacity costs to your business initiatives. Buy scale-out file and object storage with cognitive data management your way. Unstructured data creation continues at an explosive and accelerating rate and does not appear to be slowing down. Customers are looking to their trusted IT partners […]

Continue reading

Powering business at the speed of life

Mark Peters, Practice Director and Senior Analyst at Enterprise Strategy Group (ESG) observes: “Time and again our market research reminds us that it’s the needs of overall business, more than any other factors, that drive the choice and adoption of IT technologies. And, whatever those overall needs, what’s equally clear is that right now businesses […]

Continue reading