Product Management in Machine Learning // Laszlo Sragner // MLOps Meetup #54

MLOps.community

MLOps community meetup #54! Last Wednesday we talked to Laszlo Sragner, Founder, Hypergolic.
// Abstract:
How my experience in quant finance and software engineering influenced how we ran ML at a London Fintech Startup. How to solve business problems with incremental ML? What's the difference between academic and industrial ML?
// Bio:
Laszlo worked as a quant researcher at multiple investment managers and as a DS at the world's largest mobile gaming company. As Head of Data Science at Arkera, he drove the company's data strategy delivering solutions to Tier 1 investment banks and hedge funds. He currently runs Hypergolic (hypergolic.co.uk) an ML Consulting company helping startups and enterprises bring the maximum out of their data and ML operations.
// Takeaways
Continuous evaluation and monitoring is indistinguishable in a well set up product team. Separation of concerns (SE, ML, DevOps, MLOps) is very important for smooth operation, low friction team coordination/communication is key.
To be able to iterate business features into models you need a modelling framework that can express these which is usually a DL package.
DS-es are well motivated to go more technical because they see the rewards of it. All well run (from DS perspective) startups in my experience do the same.
// Other Links
Free eBook about MLPM: https://machinelearningproductmanual.com/
Lightweight MLOps Python package: https://hypergol.ml/
Blog: laszlo.substack.com
----------- Connect With Us ✌️-------------
Join our Slack community: https://go.mlops.community/slack
Follow us on Twitter: @mlopscommunity
Sign up for the next meetup: https://go.mlops.community/register
Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/
Connect with Laszlo on LinkedIn: https://www.linkedin.com/in/laszlosragner/
Timestamps:
[00:00] Introduction to Laszlo Sranger
[02:15] Laszlo's Background
[09:18] Being a Quant, then influenced, what you were doing with the Investment Banks?
[12:24] Do you think this can be applied in different use cases or specific to what you are doing?
[14:41] Do you have any thoughts of a potentially highly opinionated person?
[16:54] Product management in Machine Learning
[24:59] You have to be at a large company or you have to have a large team? [26:38] What are your thoughts on MLOps products helping with product management for ML? Is it an overreach or scope creep?
[32:00] In the messy world of startups due to the big cost of an MVP for NLP is RegEx which means to user feedbacks it's incorporated by tweaking RegEx?
[33:04] Does the ensemble recent models more than older models? If so, what is the decay rate of weights for older models?
[35:40] Since the iterative management model is generic enough for most ML projects, which component of it can be easily generalized and tools built for version control?
[36:38] Topic Extraction: What type of model do you train for that task?
[52:55] Thoughts on Notebooks
[53:34] "I don't hate notebooks. Let's be clear about that. I put it this way, notebooks are whiteboards. You don't want your whiteboards to be your output because it's a sketch of your solution. You want the purest solution."