Artwork

Content provided by Data on Kubernetes Community. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Data on Kubernetes Community or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.
Player FM - Podcast App
Go offline with the Player FM app!

The Challenges of Data Processing On Kubernetes - A look at Spark, Flink, Dask, and Ray // Holden Karau (DoK Day North America 2022)

20:09
 
Share
 

Manage episode 345761206 series 2865115
Content provided by Data on Kubernetes Community. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Data on Kubernetes Community or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.

From the DoK Day North America 2022 (https://youtu.be/YWTa-DiVljY)
ABSTRACT
This talk will go through both the improvements that have been made in Kubernetes for batch analytic workloads as well as some of the current pain experienced by users and developers moving their workloads to Kube. In this talk you will learn about how we “cheated” back in the YARN and Mesos days to make things go fast, why Kubernetes doesn’t like those cheats, and what some alternatives are.

  continue reading

243 episodes

Artwork
iconShare
 
Manage episode 345761206 series 2865115
Content provided by Data on Kubernetes Community. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Data on Kubernetes Community or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.

From the DoK Day North America 2022 (https://youtu.be/YWTa-DiVljY)
ABSTRACT
This talk will go through both the improvements that have been made in Kubernetes for batch analytic workloads as well as some of the current pain experienced by users and developers moving their workloads to Kube. In this talk you will learn about how we “cheated” back in the YARN and Mesos days to make things go fast, why Kubernetes doesn’t like those cheats, and what some alternatives are.

  continue reading

243 episodes

All episodes

×
 
Loading …

Welcome to Player FM!

Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.

 

Quick Reference Guide

Listen to this show while you explore
Play