Artwork

Content provided by Gwen. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Gwen or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.
Player FM - Podcast App
Go offline with the Player FM app!

Speed of Apache Pinot - Cost of Cloud Storage

41:29
 
Share
 

Manage episode 323751348 series 3001396
Content provided by Gwen. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Gwen or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.

Companies that take existing software and manage it in the cloud have the opportunity to rethink their architecture and use cloud services appropriately. The resulting system is often cheaper, simpler, more elastic, and more manageable.

Neha Pawar, a founding engineer at StarTree Data and a PMC member of Apache Pinot, recently published a blog post about her experiments with tiered storage for Pinot. We had an in-depth conversation about how they approached the architecture change and the challenges of achieving reasonable latencies with cloud object storage like S3.

And the big question: Why did otherwise reasonable engineers decide to tackle this project's prototype over a weekend?

Interested in more SaaS? Join our Slack: https://saas-community.github.io/

The blog post: https://www.startree.ai/blogs/introducing-tiered-storage

Twitter thread: https://twitter.com/KishoreBytes/status/1503075370240659462

  continue reading

42 episodes

Artwork
iconShare
 
Manage episode 323751348 series 3001396
Content provided by Gwen. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Gwen or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.

Companies that take existing software and manage it in the cloud have the opportunity to rethink their architecture and use cloud services appropriately. The resulting system is often cheaper, simpler, more elastic, and more manageable.

Neha Pawar, a founding engineer at StarTree Data and a PMC member of Apache Pinot, recently published a blog post about her experiments with tiered storage for Pinot. We had an in-depth conversation about how they approached the architecture change and the challenges of achieving reasonable latencies with cloud object storage like S3.

And the big question: Why did otherwise reasonable engineers decide to tackle this project's prototype over a weekend?

Interested in more SaaS? Join our Slack: https://saas-community.github.io/

The blog post: https://www.startree.ai/blogs/introducing-tiered-storage

Twitter thread: https://twitter.com/KishoreBytes/status/1503075370240659462

  continue reading

42 episodes

All episodes

×
 
Loading …

Welcome to Player FM!

Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.

 

Quick Reference Guide

Copyright 2025 | Privacy Policy | Terms of Service | | Copyright
Listen to this show while you explore
Play