))
"Real-Time" ML: Features and Inference // Sasha Ovsankin and Rupesh Gupta // MLOps Podcast #135
Manage episode 349311171 series 3241972
Content provided by Demetrios. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Demetrios or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.
MLOps Coffee Sessions #135 with Sasha Ovsankin and Rupesh Gupta, Real-time Machine Learning: Features and Inference co-hosted by Skylar Payne.
// Abstract
Moving from batch/offline Machine Learning to more interactive "near" real-time requires knowledge, team, planning, and effort. We discuss what it means to do real-time inference and near-real-time features when to do this move, what tools to use, and what steps to take.
// Bio
Sasha Ovsankin Sasha is currently a Tech Lead of Machine Learning Model Serving infrastructure at LinkedIn, worked also on Feathr Feature Store, Real-Time Feature pipelines, designed metric platforms at LinkedIn and Uber, and was co-founder in two startups. Sasha is passionate about AI, Software Craftsmanship, improvisational music, and many more things.
Rupesh Gupta
Rupesh is a Sr. Staff Engineer in the AI team at LinkedIn. He has 10 years of experience in search and recommender systems.
// MLOps Jobs board
https://mlops.pallet.xyz/jobs
// MLOps Swag/Merch
https://mlops-community.myshopify.com/
// Related Links
--------------- ✌️Connect With Us ✌️ -------------
Join our slack community: https://go.mlops.community/slack
Follow us on Twitter: @mlopscommunity
Sign up for the next meetup: https://go.mlops.community/register
Catch all episodes, blogs, newsletters, and more: https://mlops.community/
Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/
Connect with Skylar on LinkedIn: https://www.linkedin.com/in/skylar-payne-766a1988/
Connect with Sasha on LinkedIn: https://www.linkedin.com/in/sashao/
Connect with Rupesh on LinkedIn: https://www.linkedin.com/in/guptarupesh
Timestamps:
[00:00] Sasha's and Rupesh's preferred coffee
[01:30] Takeaways
[07:23] Changes in LinkedIn
[09:21] "Real-time" Machine Learning in LibnkedIn
[13:08] Value of Feedback
[14:24] Technical details behind getting the most recent information integrated into the models
[16:53] Embedding Vector Search action occurrence
[18:33] Meaning of "Real-time" Features and Inference
[20:23] Are "Real-time" Features always worth that effort and always helpful?
[23:22] Importance of model application
[25:26] Challenges in "Real-time" Features
[30:40] System design review on Pinterest
[36:13] Successes of real-time features
[38:31] Learnings to share
[45:52] Branching for Machine Learning
[48:44] Not so talked about discussion of "Real-time"
[51:09] Wrap up
451 episodes
Share
