For more than two decades, IBM has helped the Augusta National Golf Club gather, analyze and use an ocean of data to deliver engaging insights and content to the Masters® app. In addition to traditional scores and stats, state-of-the art cameras, microphones and lasers capture video, sound, and the precise x, y and z coordinates of more than 20,000 shots over the four days of the tournament. On top of the real-time data, there’s a trove of historical data to consider: player performance coming into the tournament and in previous Masters tournaments, and player statistics such as greens in regulation and putting efficiency.

This data is the raw material of the Masters digital experience. It’s routed to multiple clouds, integrated and fed into AI models to build a wide variety of features in the Masters app. Fans can create custom video feeds, get automated video highlights, see projected scores and build out their Masters Fantasy roster with the help of AI-generated player insights.

“The Masters is a uniquely compelling sporting event, steeped in tradition and respect for the beauty of the game,” says Noah Syken, Vice President of Sports and Entertainment Partnerships at IBM. “Working with the digital teams, we’re able to deliver data-driven insights to patrons through an app that maintains the simplicity and design aesthetic they’ve come to expect from every experience at the tournament.”

Training AI on the language of golf

This year, thanks to AI-driven natural language processing, some of the data can literally speak for itself. At the 2023 Masters, IBM is using generative AI technology to add audio descriptions to video of every shot at the Masters. The essence of this generative AI project is reverse engineering: discovering rules and patterns within huge data sets to inform a system that can generate useful solutions on demand, such as shot-by-shot golf commentary.

For the large language model or foundation model, the “huge data set” used was the C4 (colossal clean crawled corpus), consisting of petabytes of web data and metadata collected over 12 years, that identifies millions of parameters. The next step was to fine-tune the model to the appropriate domain of expertise.

“We had to teach the system the language of golf,” says Stephen Hammer, Sports CTO and IBM Distinguished Engineer. “Which begins with creating a set of concepts and categories—an ontology—that draws relationships between golf rules, how it’s organized around holes, tees, par numbers and distances. Then we fill in the ontology with details from actual game play. That helps the system query and figure out the game in a way it understands, extracting information from the ontology that’s used to further train itself on how to write base sentences.” These base sentences (essentially templates that convey the concept of people playing golf) are the root of the data-to-text process.

The system was also trained to use the language of the Masters, which has its own vocabulary. For example, a sand trap is a “bunker” and the rough is the “second cut.”

The next step is to generate candidate sentences with syntactical variability, such as “His shot finds the pine straw” and “That drive ends up in the pine straw.” These are then weighted by the likelihood of their occurrence. “We encode the system to use the most common ways of saying things,” says Hammer. “And once the system phrases something in certain way, it will be less likely to say it the same way again. Every single shot, no matter how similar, could produce a different sentence.”

Because the AI system is, in effect, “watching” the action in real time, instructions were required around its verbosity, so it wouldn’t be talking nonstop. “A golf shot is made up of three items. A setup, so we create a sentence for that. Then he hits the ball, and it’s moving—we don’t create a sentence for that. And then the ball stops, and we create a sentence for that outcome,” says Hammer.

The team equipped the system with semantic variability so it can describe possible situations, from whiffing a tee shot (unlikely at the Masters) to making a hole-in-one, as well as things that could happen in between.

Lastly, the speaking persona, selected in collaboration with Augusta National, had to be taught to pronounce domain-specific words and phrases. “We couldn’t have the voice saying, ‘minus one’ when it meant ‘one under,’ and we had to ensure it could pronounce players’ names correctly,” says Syken. A team listened to the sentences to flag things the system was getting wrong, then entered phonetic spellings into the dictionary and retrained the system.

“The Masters is a great example of how powerful AI and machine learning models can transform data into world-class digital experiences,” says Syken.

See how IBM Consulting created a platform of innovation for the Masters Read how a data fabric can accelerate innovation through multicloud data integration

More from Artificial intelligence

The five key benefits of AIOps and automation

4 min read - If you’re an IT professional—from the C-suite to a hands-on practitioner—you know the pressure your IT operations (ITOps) are under. You’re responsible for optimizing spend, operational efficiency and incorporating new and innovative technologies. But are your tools slowing you down? Coined by research firm Gartner, AIOps is artificial intelligence for IT operations. It is the application of artificial intelligence (AI) capabilities (e.g., natural language processing and machine learning models) to automate and streamline operational workflows. In this blog post, we…

4 min read

What is smart transportation?

5 min read - Every day, people encounter multiple obstacles while traveling to their intended destinations. Sitting in traffic, waiting for the bus to arrive 15 minutes later than scheduled, driving around for 30 minutes to find a parking spot—the modern world is full of inconveniences due to underlying inefficiencies in our transportation systems. However, stalled cars and harried people waiting for public transportation aren’t just an individual nuisance. A less-than-optimal transportation infrastructure affects the economy, hastens environmental impact and lowers the overall quality…

5 min read

IBM named a Leader in the latest Forrester Wave™ report for AI Decisioning

2 min read - Forrester Research just released "The Forrester Wave™: AI Decisioning Platforms, Q2 2023: The 13 Providers That Matter Most And How They Stack Up" by Mike Gualtieri with Aaron Katz, Catherine Marcin, and Jen Barton, and IBM is proud to be recognized as a Leader.  This report outlines the combination of traditional decision automation tools with machine learning models and other technologies. As Forrester notes in the report, many organizations are eager to harness the power of AI but also must…

2 min read

Capgemini and IBM Ecosystem strengthen partnership for Drone-as-a-Service

5 min read - Today, utilities and many other industries use drones extensively to conduct surveys, map assets and monitor business operations. They use drones for tasks as simple as aerial photography or as complex as sophisticated data collection and processing. The global commercial drone market is projected to grow from USD 8.15 billion in 2022 to USD 47.38 billion by 2029, at a CAGR of 28.58% in the forecast period. Different drone requirements require different investments such as commercial drone pilots with specialized…

5 min read