33 subscribers
Go offline with the Player FM app!
Making LLMs hallucinate less, how to diagnose ML models, from PM in Google AI to CEO of Galileo - Vikram Chatterji - The Data Scientist Show #066
Manage episode 372919414 series 3012777
Vikram is the co-founder of Galileo – an AI diagnostics and explainability platform used by data science teams building NLP, LLMs and Computer Vision models across the Fortune 500 and high growth startups. Prior to Galileo, Vikram led Product Management at Google AI, where his team built models for the Fortune 2000 across retail, financial services, healthcare and contact centers. He has a master degree from Carnegie Mellon University from the school of computer science. If you enjoy the show, subscribe to the channel and leave a 5-star review. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.
Resources:LLM Studio: https://www.rungalileo.io/blog/announcing-llm-studio
Galileo: https://www.rungalileo.io/
Blog on LLM Hallucination: https://thesequence.substack.com/p/guest-post-stop-hallucinations-from
Vikram Chatterji’s LinkedIn: https://www.linkedin.com/in/vikram-chatterji/
"The Mom Test": https://www.amazon.com/The-Mom-Test-Rob-Fitzpatrick-audiobook/dp/B07RJZKZ7F
Daliana's Twitter: https://twitter.com/DalianaLiu
Daliana's LinkedIn: https://www.linkedin.com/in/dalianaliu
(00:00:00) Introduction
(00:04:24) How he got into machine learning
(00:06:53) Diagnosing large language models
(00:09:56) Addressing model hallucination
(00:12:46) Metrics for measuring hallucination
(00:17:30) From Google AI to starting Galileo
(00:24:08) Developing LLMs and putting them into production
(00:32:51) Galileo's diagnostics and explainability platform
(00:43:16) Advice for data scientists when joining a startup
93 episodes
Manage episode 372919414 series 3012777
Vikram is the co-founder of Galileo – an AI diagnostics and explainability platform used by data science teams building NLP, LLMs and Computer Vision models across the Fortune 500 and high growth startups. Prior to Galileo, Vikram led Product Management at Google AI, where his team built models for the Fortune 2000 across retail, financial services, healthcare and contact centers. He has a master degree from Carnegie Mellon University from the school of computer science. If you enjoy the show, subscribe to the channel and leave a 5-star review. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career.
Resources:LLM Studio: https://www.rungalileo.io/blog/announcing-llm-studio
Galileo: https://www.rungalileo.io/
Blog on LLM Hallucination: https://thesequence.substack.com/p/guest-post-stop-hallucinations-from
Vikram Chatterji’s LinkedIn: https://www.linkedin.com/in/vikram-chatterji/
"The Mom Test": https://www.amazon.com/The-Mom-Test-Rob-Fitzpatrick-audiobook/dp/B07RJZKZ7F
Daliana's Twitter: https://twitter.com/DalianaLiu
Daliana's LinkedIn: https://www.linkedin.com/in/dalianaliu
(00:00:00) Introduction
(00:04:24) How he got into machine learning
(00:06:53) Diagnosing large language models
(00:09:56) Addressing model hallucination
(00:12:46) Metrics for measuring hallucination
(00:17:30) From Google AI to starting Galileo
(00:24:08) Developing LLMs and putting them into production
(00:32:51) Galileo's diagnostics and explainability platform
(00:43:16) Advice for data scientists when joining a startup
93 episodes
All episodes
×
1 Why I’m ending this show. Death, afterlife, Chinese philosophy, and what’s next? Daliana Liu ft. Tina Huang #92 44:24

1 Unfiltered advice - How to advance your career in data science & ML - The Data Scientist Show with Daliana Liu and Jon Krohn #091 1:33:38

1 From Meta to independent data consultant, Seattle Data Guy moved to Denver, Ben Rogojan, the data scientist show #090 1:02:13

1 Why data scientists are tired, six real data scientists' frustrations - The Data Scientist Show #089 42:22

1 Why 80% of A/B tests fail, how to 10X your experimentation velocity - Kristi Angel - The Data Scientist Show #088 43:46

1 From physics PhD to data science leader, unexpected challenges in survey data, Python vs R, EDA best practices, building MLOps toolkit - Julia Silge - The Data Scientist Show #087 46:18

1 Why he created Pandas, the future of data systems, why he left his CTO role to become a chief architect - Wes McKinney - The Data Scientist Show #086 52:24

1 From financial analyst to director of analytics, how to get promoted quickly, 7 elements of influence - Christopher Fricker - The Data Scientist Show #085 1:13:51

1 Adapters: the game changer for fine-tuning - Geoffrey Angus - The Data Scientist Show #084 52:45

1 Landing a job by analyzing Seattle's crime data, from data scientist to founder of interview query, building a lifestyle business - Jay Feng - The Data Scientist Show #083 35:41

1 Case studies from the GenAI frontier, scaling ML teams, from biologist to machine learning consultant- Erik Gafni - The Data Scientist Show #082 1:03:40

1 Data science job market in 2024, softskills for interviews, AI engineering - Jay Feng - The Data Scientist Show #081 1:07:14

1 How to handle being laid off (as data scientists), severance negotiation, full-time employment vs independent consultant - The Data Scientist Show #080 1:06:33

1 From data analyst to sales engineer, personality-based career design, sales skills for data people - Jenny Wu - The Data Scientist Show #079 57:26

1 The future of data science teams, integrating AI into data science workflows, building data apps for stakeholders - Barry McCardel - The Data Scientist Show #078 1:04:56
Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.