Last year, seeking to reclaim its position as Brazil’s biggest automaker, Volkswagen do Brasil, launched an entirely new sedan, the Virtus, designed specifically for Latin America’s largest car market.

One of the biggest changes was not to the engine, the trunk or the paint job, though. It came to the glove compartment. Or what might better be described in Brazil as the bookcase.

Brazilian law requires all passenger vehicles to come with no fewer than six manuals, including functionality, maintenance, security, even one just for the radio. As VW do Brasil, a subsidiary of the Volkswagen Group, rethought every aspect of their car, the designers began to wonder if there might be a way to bring the humble owner’s manual into the 21st century.

It may lack the flamethrower of KITT from Knight Rider, but the Virtus’ Manual Cognitivo is just as capable of saving the day when its driver is in a bind.

Built on a Watson-powered smartphone platform, the Manual Cognitivo responds to more than 8,000 spoken commands covering 150 different vehicular situations. Drivers can also snap a photo of 22 different dashboard alerts, and the app can explain exactly what the issue is. And thanks to its built-in AI, the system can learn and adapt over time.

The days of mysterious “check-engine” warnings or reaching for the glove compartment for anything but gloves or napkins are coming to an end.

“Imagine you could turn on the car and just talk to the manual,” said Andréa Crespo, a data science and AI expert at IBM Brazil in São Paulo.

Volkswagen and IBM have a longstanding partnership, whether building e-commerce platforms or developing mobility solutions. When VW do Brasil needed to achieve reliable voice recognition for the Manual Cognitivo—something capable of responding whether the Virtus was parked in the garage, speeding down the highway or stuck on a mountain road—the Watson team at IBM iX was ready.

“We look at AI as perhaps the most critical element of our innovation leadership strategy in Brazil,” said Fabio Rabelo, the head of digital and new business models at Volkswagen do Brasil.

His team chose a phone-based app, so owners can address issues and get answers even when not in their vehicle. The system can integrate with the car through Apple’s Carplay, Android Auto or MirrorLink.

Creating a seamless system goes beyond being able to understand commands like “How do I check the tire pressure?” or “How do I fade the stereo to the front since the twins are napping in back?”

The app also had to be personalized, recognizing the owner’s name and voice, the model of the car, even details like the paint job and wheel package. And the Manual Cognitivo also had to understand Brazil’s various dialects and regionalisms, as well as being adapted to Spanish, to serve VW vehicles across Latin America.

The Manual Cognitivo interface. (VW Group)

Yet the biggest challenge was pace. Because the car was so new, its features, and any discussion of them, had to be kept secret until the last possible moment. This left the Watson team four months to develop its program, including only a month for testing.

Not being able to talk to an AI built for voice recognition is quite the challenge.

“It’s important to have the feedback,” Crespo said. “We needed people talking and people’s behavior, this is what makes the artificial intelligence smarter.”

Even so, the Watson system achieved 89 percent audio accuracy within this accelerated testing phase, and 90 percent on visual prompts.

Ben Stanley, the global research lead for automotive, aerospace and defense at IBM’s Institute for Business Value, said the Manual Cognitivo represents the latent phases of the massive shift automakers will make from manufacturers of products to providers of services.

“They have to move to an experience-based platform,” Stanley said. “If the car is driving itself in 10 years, you don’t care about the performance, you care about the experience inside and outside the car.”

The Manual Cognitivo has certainly demonstrated the value of these technological investments. The VW-IBM platform helped make the Virtus one of the most popular cars in South America, where Volkswagen Group’s vehicle deliveries were up almost 12 percent in 2018, including a whopping 28 percent in Brazil (the best performance of any country for the company).

The Virtus helped drive VW sales in Brazil to the company’s best worldwide in 2018. (VW Group)

The success of the Virtus was a big part of why the Manual Cognitivo has since been rolled out into a trio of existing models on the continent: the Tiguan and T-Cross SUVs and Jetta sedan.

These AI features also helped VW do Brasil reassert its position as a cutting-edge automaker, with the Virtus winning more than 20 consumer and industry awards, the most of any model in 2018. And they also sparked interest among the millennial and Gen Z buyers VW covets as long-term customers.

While consumer interest was the driving factor for developing the Manual Cognitivo, it has provided ample additional benefits. Notably, customer calls and help requests to VW’s call centers have decreased over the past year, leading to manpower savings.

Nor is the innovating over. VW do Brasil and IBM are studying the real-world queries customers have been making for a year and a half now, which are inspiring new features both for the Manual Cognitivo as well as VW vehicles overall.

“The more cars they’re in, the better the program, and they can develop more features, connect to more security, get restaurant reservations, et cetera,” Crespo said.

And so this is but the first chapter in the Virtus’ story.

More from Automotive

Driving EV adoption forward requires collaboration and a focus on sustainability

For any country’s net-zero emissions pathway, transport is an early and key sector to de-carbonize. So key, in fact, that some countries have begun to impose future deadlines prohibiting the sale of internal combustion engine (ICE) vehicles—a very strong signal for the adoption of electric vehicles (EVs). Recent data from the IBM Institute for Business Value (IBV) reveals that consumer demand for electric vehicles is increasing, but roadblocks persist in advancing the EV transition. The study*, An on-ramp to sustainable…

Visual inspection for improved quality in manufacturing

The challenges of quality inspection in manufacturing Manufacturing operations strive to deliver the highest quality during every stage of the production or assembly process. Over half of these quality checks involve visual confirmation to ensure the parts are in the correct locations, have the right shape or color or texture, and are free from any blemishes such as scratches, pinholes, foreign particles, etc. Automating these visual quality checks is very difficult because of the volume of inspections and product variety,…

Industry 4.0 and the pursuit of resiliency

Downtime can cost a manufacturer upwards of USD 21,000 per minute. Fortunately, AI has evolved to accurately identify issues and take action. This advanced technology allows companies to easily add intelligent “eyes” to their operations with standard mobile devices — the same smartphones and tablets that you’re using right now. All to quickly identify defects in production outputs as well as remotely monitor assets for potential disruptions. I talked with IBM expert Scott Campbell about this AI evolution and his…

Ford presents its prestigious IT Innovation Award to IBM

Over 100 years ago, Henry Ford said, “Quality means doing it right when no one is looking.” Ensuring quality by meticulously inspecting work and materials was less complicated when Ford produced a single vehicle model in one color — black. Flash forward to 2020: The Ford Motor Company produced 1.7 million vehicles1 across multiple models with dozens of options packages. You can imagine the challenges to “looking” at every facet of the manufacturing process. That’s one of the reasons why…