881: Beyond GPUs: The Power of Custom AI Accelerators, with Emily Webber

Super Data Science: ML & AI Podcast with Jon Krohn

Content provided by Jon Krohn. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Jon Krohn or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://staging.podcastplayer.com/legal.

5d ago 1:17:06

MP3•Episode home

Emily Webber speaks to Jon Krohn about her work at Amazon Web Services, from its Annapurna Labs-developed Nitro System, a foundational technology that can enhance securities and performance in the cloud and how Trainium2 became AWS’ most powerful AI chip with four times the compute of Trainium. Hear the specs of AWS’s chips and when to use them.

Additional materials: www.superdatascience.com/881

This episode is brought to you by ODSC, the Open Data Science Conference.

Interested in sponsoring a SuperDataScience Podcast episode? Email [email protected] for sponsorship information.

In this episode you will learn:

(08:36) Emily’s work on AWS’ SageMaker and Trainium
(23:54) How AWS Neuron lets builders tailor their approach to using frameworks
(29:07) Why using an accelerator is better than using a GPU
(35:29) The key differences between AWS Trainium and AWS Trainium2
(52:45) How to select between AWS Trainium and AWS Trainium2

1191 episodes

#Data Science #Science #Tech #Software Development #Jon Krohn