25 subscribers
Go offline with the Player FM app!
Episode 23: Statistical and Algorithmic Thinking in the AI Age
Manage episode 390647487 series 3317544
Hugo speaks with Allen Downey, a curriculum designer at Brilliant, Professor Emeritus at Olin College, and the author of Think Python, Think Bayes, Think Stats, and other computer science and data science books. In 2019-20 he was a Visiting Professor at Harvard University. He previously taught at Wellesley College and Colby College and was a Visiting Scientist at Google. He is also the author of the upcoming book Probably Overthinking It!
They discuss Allen's new book and the key statistical and data skills we all need to navigate an increasingly data-driven and algorithmic world. The goal was to dive deep into the statistical paradoxes and fallacies that get in the way of using data to make informed decisions.
For example, when it was reported in 2021 that “in the United Kingdom, 70-plus percent of the people who die now from COVID are fully vaccinated,” this was correct but the implication was entirely wrong. Their conversation jumps into many such concrete examples to get to the bottom of using data for more than “lies, damned lies, and statistics.” They cover
- Information and misinformation around pandemics and the base rate fallacy;
- The tools we need to comprehend the small probabilities of high-risk events such as stock market crashes, earthquakes, and more;
- The many definitions of algorithmic fairness, why they can't all be met at once, and what we can do about it;
- Public health, the need for robust causal inference, and variations on Berkson’s paradox, such as the low-birthweight paradox: an influential paper found that that the mortality rate for children of smokers is lower for low-birthweight babies;
- Why none of us are normal in any sense of the word, both in physical and psychological measurements;
- The Inspection paradox, which shows up in the criminal justice system and distorts our perception of prison sentences and the risk of repeat offenders.
LINKS
53 episodes
Manage episode 390647487 series 3317544
Hugo speaks with Allen Downey, a curriculum designer at Brilliant, Professor Emeritus at Olin College, and the author of Think Python, Think Bayes, Think Stats, and other computer science and data science books. In 2019-20 he was a Visiting Professor at Harvard University. He previously taught at Wellesley College and Colby College and was a Visiting Scientist at Google. He is also the author of the upcoming book Probably Overthinking It!
They discuss Allen's new book and the key statistical and data skills we all need to navigate an increasingly data-driven and algorithmic world. The goal was to dive deep into the statistical paradoxes and fallacies that get in the way of using data to make informed decisions.
For example, when it was reported in 2021 that “in the United Kingdom, 70-plus percent of the people who die now from COVID are fully vaccinated,” this was correct but the implication was entirely wrong. Their conversation jumps into many such concrete examples to get to the bottom of using data for more than “lies, damned lies, and statistics.” They cover
- Information and misinformation around pandemics and the base rate fallacy;
- The tools we need to comprehend the small probabilities of high-risk events such as stock market crashes, earthquakes, and more;
- The many definitions of algorithmic fairness, why they can't all be met at once, and what we can do about it;
- Public health, the need for robust causal inference, and variations on Berkson’s paradox, such as the low-birthweight paradox: an influential paper found that that the mortality rate for children of smokers is lower for low-birthweight babies;
- Why none of us are normal in any sense of the word, both in physical and psychological measurements;
- The Inspection paradox, which shows up in the criminal justice system and distorts our perception of prison sentences and the risk of repeat offenders.
LINKS
53 episodes
All episodes
×
1 Episode 53: Human-Seeded Evals & Self-Tuning Agents: Samuel Colvin on Shipping Reliable LLMs 44:49

1 Episode 52: Why Most LLM Products Break at Retrieval (And How to Fix Them) 28:38

1 Episode 51: Why We Built an MCP Server and What Broke First 47:41

1 Episode 50: A Field Guide to Rapidly Improving AI Products -- With Hamel Husain 27:42

1 Episode 49: Why Data and AI Still Break at Scale (and What to Do About It) 1:21:45

1 Episode 48: HOW TO BENCHMARK AGI WITH GREG KAMRADT 1:04:25

1 Episode 47: The Great Pacific Garbage Patch of Code Slop with Joe Reis 1:19:12

1 Episode 46: Software Composition Is the New Vibe Coding 1:08:57

1 Episode 45: Your AI application is broken. Here’s what to do about it. 1:17:30

1 Episode 44: The Future of AI Coding Assistants: Who’s Really in Control? 1:34:11

1 Episode 43: Tales from 400+ LLM Deployments: Building Reliable AI Agents in Production 1:01:03

1 Episode 42: Learning, Teaching, and Building in the Age of AI 1:20:03

1 Episode 41: Beyond Prompt Engineering: Can AI Learn to Set Its Own Goals? 43:51

1 Episode 40: What Every LLM Developer Needs to Know About GPUs 1:43:34

1 Episode 39: From Models to Products: Bridging Research and Practice in Generative AI at Google Labs 1:43:28
Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.