Artwork

Content provided by open.intel. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by open.intel or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.
Player FM - Podcast App
Go offline with the Player FM app!

The Future of AI Workloads with Slinky

18:51
 
Share
 

Manage episode 477383602 series 3446189
Content provided by open.intel. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by open.intel or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.

In this episode, Marlow Warnicke, lead for the Slinky project, and Tim Wickberg, CTO of SchedMD, join us to discuss their work integrating HPC scheduler Slurm with Kubernetes. They provide background on Slurm's origins, its open source nature, and its evolution into Slinky to address Kubernetes's limitations in scheduling AI and HPC workloads. The discussion touches on the unique challenges in the MLOps space, the need for fine-grained resource control, and their collaborative efforts with various communities to enhance Kubernetes's efficiency. They also share the roadmap for Slinky and avenues for community collaboration and contribution.

00:00 Introduction and Guest Introductions

00:39 Overview of Slurm and Its Evolution

01:44 The Fusion of Slurm and Kubernetes: Slinky

04:14 Challenges in Kubernetes Scheduling

09:07 Unique Challenges in MLOps

12:58 Community Collaboration and Future Plans

16:41 Getting Involved and Final Thoughts

  continue reading

100 episodes

Artwork
iconShare
 
Manage episode 477383602 series 3446189
Content provided by open.intel. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by open.intel or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.

In this episode, Marlow Warnicke, lead for the Slinky project, and Tim Wickberg, CTO of SchedMD, join us to discuss their work integrating HPC scheduler Slurm with Kubernetes. They provide background on Slurm's origins, its open source nature, and its evolution into Slinky to address Kubernetes's limitations in scheduling AI and HPC workloads. The discussion touches on the unique challenges in the MLOps space, the need for fine-grained resource control, and their collaborative efforts with various communities to enhance Kubernetes's efficiency. They also share the roadmap for Slinky and avenues for community collaboration and contribution.

00:00 Introduction and Guest Introductions

00:39 Overview of Slurm and Its Evolution

01:44 The Fusion of Slurm and Kubernetes: Slinky

04:14 Challenges in Kubernetes Scheduling

09:07 Unique Challenges in MLOps

12:58 Community Collaboration and Future Plans

16:41 Getting Involved and Final Thoughts

  continue reading

100 episodes

All episodes

×
 
Loading …

Welcome to Player FM!

Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.

 

Quick Reference Guide

Listen to this show while you explore
Play