Home

Think

Podcasts

Mixture of Experts

Episode 40

DeepSeek facts vs. hype, model distillation and open-source competition

Watch the episode
Episode 40: DeepSeek facts vs. hype, model distillation and open-source competition

Let’s bust some early myths about DeepSeek. In episode 40 of Mixture of Experts, join host Tim Hwang and experts Aaron BaughmanChris Hay and Kate Soule as they break down this week’s top news and trends in AI.

Last week, we covered the release of DeepSeek-R1. Now that the entire world is up to speed, join us as we separate the facts from the hype. Next, listen to the discussion on model distillation and why it matters for competition in AI. Finally, dive into Sam Altman’s response to DeepSeek and whether R1 will radically reshape the open-source strategy of other tech giants. Find out all this and more on Mixture of Experts.

Key takeaways:

  • 00:01 - Intro
  • 00:41 - DeepSeek facts versus hype
  • 21:00 - Model distillation
  • 31:21 - Open source and OpenAI

The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

View all Mixture of Experts episodes
Listen on Apple Podcasts Spotify Podcasts Casted YouTube
Explore more episodes DeepSeek-R1, Mistral IPO, FrontierMath controversy and IDC code assistant report

What does the future hold for DeepSeek? In episode 39 of Mixture of Experts, our panel debriefs DeepSeek-R1, Mistral's IPO indication, the FrontierMath controversy and the IDC gen AI code assistants report.

Anthropic valuation rumors, Microsoft CoreAI, NotebookLM upgrades and AI agents in finance

What would you do with USD 2 billion? In episode 38 of Mixture of Experts, we discuss the Anthropic valuation rumors, CoreAI, NotebookLM upgrades and AI agents within the financial services industry.

CES 2025, NVIDIA DIGITS, Apple Intelligence fails and Sam Altman’s reflections

What’s the most exciting CES AI announcement? In episode 37 of Mixture of Experts, we debrief CES 2025, NVIDIA DIGITS, Apple Intelligence fails, Sam Altman’s reflection blog and the challenges facing enterprise AI developers.

Watch the first episode from Mixture of Experts
Watch episode 1