Listen to episode 34 of Mixture of Experts

Episode 34: IBM Granite 3.1, NVIDIA Jetson, stealing AI models and is pretraining over?

Is pretraining a thing of the past? In episode 34 of Mixture of Experts, host Tim Hwang teams up with Abraham Daniels, Vagner Santana and Volkmar Uhlig to dive deep into this week’s breaking news in AI. Join the conversation and unpack OpenAI cofounder Ilya Sutskever’s claim that we’ve reached “peak data”. Does this mean that there is no longer a need for model pretraining?

Next, explore the slew of features introduced with the latest release of IBM® Granite™ 3.1 as we cover them all. Then, dive into the new way to steal AI models, and how do we protect against model exfiltration. Finally, let’s examine whether NVIDIA Jetson for AI developers can really increase hardware accessibility. Tune in for all this and more!

Key takeaways:

00:01—Intro
00:49—Is pretraining over?
10:45—IBM Granite 3.1
22:23—AI model stealing
33:38—NVIDIA Jetson

The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Learn more about artificial intelligence.
📩 Sign up for a monthly newsletter for AI updates from IBM.
Explore IBM Granite models.
Learn how to build a document-based question answering system by using Docling with Granite 3.1

View all Mixture of Experts episodes

Listen on

Explore more episodes

12 Days of OpenAI, NeurIPS, ARC Prize and Llama 3.3 70B

Is o1 Pro worth the cost? In episode 33 of Mixture of Experts, host Tim Hwang is joined by Marina Danilevsky, Kate Soule and Vyoma Gajjar. Today, we cover 12 Days of Open AI, NeurIPS, ARC Prize and Meta’s Llama 3.3 70B release!

Inside AWS re:Invent 2024, LLM Flowbreaking and David Mayer

What’s the mystery behind the name ChatGPT refuses to discuss? In episode 32 of Mixture of Experts, host Tim Hwang joins Aaron Baughman, Vagner Figueredo de Santana and Shobhit Varshney to chat about AWS re:Invent 2024 and LLM Flowbreaking. They also discuss David Mayer, a name that breaks ChatGPT.

AI in education: Safety, literacy and predictions

How much future learning will be done with an AI assistant? In episode 31 of Mixture of Experts, host Tim Hwang is joined by Phaedra Boinodiris, Marina Danilevsky and Skyler Speakman for the AI in education special episode!

You might like

View all podcasts

IBM Granite

Explore IBM® Granite™, our family of open, performant, and trusted AI models tailored for business and optimized to scale your AI applications.

AI in Action

Discover how we use AI to build experiences amidst all the hype about what AI can do. In this series, our host Albert Lawrence together with business leaders and IBM technologists bypass the theoretical rhetoric and show you how to put AI into practice.

Smart Talks with IBM

Be inspired by conversations between people who are at the forefront of innovation. Tune in to hear Malcolm Gladwell—one of the world’s most renowned thinkers and writers in social science—talk to leaders about technology that can transform your business.

Transformers

Hosted by Ann Funai, CIO and VP of Business Platforms Transformation at IBM, Transformers takes you behind the scenes and screens of today’s transformative leaders. Explore their real-world challenges, inspiring lessons and practical best practices. From personal transformations to the transformative influences around them, Ann and her guests explore what it truly means to be transformers.

AI Academy

Watch AI Academy, a new flagship AI for business educational experience. Gain insights from top IBM thought leaders on effectively prioritizing the AI investments that can drive growth, through a course designed for business leaders such as yourself.

AI insights, delivered 📩 Sign up for our newsletter

Get a curated selection of AI topics, trends and research sent directly to your inbox.

Watch the first episode from Mixture of Experts

Watch episode 1