Artificial Intelligence

A Parable: “The Blind GPUs and the Elephant”

Share this post:

“…Each blind man feels a different part of the elephant body, but only one part, such as the side or the tusk. They then describe the elephant based on their partial experience and their descriptions are in complete disagreement on what an elephant is.” – The Rigveda

This parable is helpful describing the problem that we are solving and context for the promising early results we have achieved in image recognition with deep learning. Despite initial disagreement, if these people are given enough time they can share enough information to piece together a pretty accurate collective picture of an elephant.

Deep learning is a widely used AI method to help computers understand and extract meaning from images and sounds through which humans experience much of the world. It holds promise to fuel breakthroughs in everything from consumer mobile app experiences to medical imaging diagnostics. But progress in accuracy and the practicality of deploying deep learning at scale is gated by technical challenges, such as the need to run massive and complex AI models – a process for which training times are measured in days and weeks.

For our part, my team in IBM Research has been focused on reducing these training times for large models with large data sets. Our objective is to reduce the wait-time associated with deep learning training from days or hours to minutes or seconds, and enable improved accuracy of these AI models. To achieve this, we are tackling grand-challenge scale issues in distributing deep learning across large numbers of servers and GPUs.

As a result, when we scaled to a large cluster with 100s of GPUs, it yielded record image recognition accuracy of 33.8% on 7.5M images from the ImageNet-22k dataset vs. the previous best published result of 29.8% by Microsoft.

Read more about our record image recognition accuracy on my article on the IBM Research blog.

IBM Fellow

More Artificial Intelligence stories

Amplifying the Power of Debate with AI

French essayist, Joseph Joubert, wrote in 1896: “It is better to debate a question without settling it than to settle a question without debating it.” For the last 15 years, I’ve led the nation’s most popular debate organization, ProCon.org. While our public charity has served more than 180 million people since 2004, our obsession with […]

Continue reading

Bringing Precision Weather Forecasting to Motorsports with Aston Martin Red Bull Racing

From precision manufacturing and aerodynamic calibration, to tire selection and race-day strategy, Formula One racing is a data-driven sport. To win, racing teams must excel on the razor’s edge, balancing control and strategy with technology and the ability to make critical, real-time decisions in a high-stakes, high-speed environment. Cars can accelerate to 100mph in less […]

Continue reading

An Appreciation: Spike Beitzel

As a young boy, Spike Beitzel visited an uncle who lived on a high, windy bluff in Nantucket. He wondered why the houses in the small community were made of wood. “Rigid houses would have been knocked down years ago,” he recalled, drawing on the reference to talk about IBM. “We have to be flexible […]

Continue reading