Bitcoin pioneer Charlie Shrem peels back the layers on the lives and backgrounds of the world's most impactful innovators. Centering around intimate narratives, Shrem uncovers a detailed, previously unspoken story of the genesis and evolution of bitcoin, cryptocurrency, artificial intelligence, and the web3 movements. Join Shrem as he journeys through the uncharted territories of tech revolutions, revealing the human side of the stories that shaped the digital world we live in today.
…
continue reading
Content provided by Patrick McKenzie. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Patrick McKenzie or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.
Similar to Complex Systems with Patrick McKenzie (patio11)
Best Business Podcast (Gold), British Podcast Awards 2023 How do you build a fully electric motorcycle with no compromises on performance? How can we truly experience what the virtual world feels like? What does it take to design the first commercially available flying car? And how do you build a lightsaber? These are some of the questions this podcast answers as we share the moments where digital transforms physical, and meet the brilliant minds behind some of the most innovative products a ...
…
continue reading
Matching real people, asking real questions about their money, with experienced Financial Advisors. You’ll hear answers to important questions like: Is now the right time to buy a house? What to do if your business fails? How should I be saving to cover the cost of college? How much do I really need to retire and am I on track? Join us as our guests share their stories around life's major moments. And hear the difference a conversation can make. Hosted by Morgan Stanley Wealth Management’s J ...
…
continue reading
The show that helps you maximize your wealth by turning complex financial situations into actionable advice. On Your Money. Your Mission., we answer the questions you’ve been asking about -- financial planning, investing, retirement and everything in between. Whether you’re navigating the complexities of the market or looking for the best ways to save or spend your money, tune in to hear from experienced financial advisors with JFG. Walk away from each episode with savvy tips and financial t ...
…
continue reading
Capitalmind looks at stocks, bonds, funds and the macro to bring you their view on the Indian financial markets. We discuss all things related to investing at our focussed podcast that keeps it simple. For more, go to capitalmind.in and to invest with us, visit capitalmindwealth.com
…
continue reading
Big tech is transforming every aspect of our world. But how, and at what cost? This season of Land of the Giants – The Disney Dilemma – focuses on Disney’s ability to weather the ups and downs of the business cycle and changing tastes and explores what has kept it successful for over 100 years. The entertainment giant has leveraged nostalgia and its intellectual property to build a beloved brand, but after an acquisition spree that included Marvel, Lucasfilm, and 20th Century Fox, can it sus ...
…
continue reading
An archive of each full weekday episode of the award-winning program presented by Stephen Grootes.
…
continue reading
Decoder is a show from The Verge about big ideas — and other problems. Verge editor-in-chief Nilay Patel talks to a diverse cast of innovators and policymakers at the frontiers of business and technology to reveal how they’re navigating an ever-changing landscape, what keeps them up at night, and what it all means for our shared future.
…
continue reading
A podcast for developers interested in building great software products. Every episode, Adam Wathan is joined by a guest to talk about everything from product design and user experience to unit testing and system administration.
…
continue reading
Save more and spend less is more than just a motto for money expert Clark Howard; it’s a way of life. Clark and his crew — Team Clark — are on a mission to empower people to take control of their personal finances by providing money-saving tips, consumer advice, hot deals and economic news to help everyone achieve financial freedom. Clark is a nationally syndicated radio talk show host and a consumer reporter for television stations around the country. His podcast, The Clark Howard Show, rec ...
…
continue reading
Player FM - Podcast App
Go offline with the Player FM app!
Go offline with the Player FM app!
))
AI and the great developer speed-up, with Joel Becker of METR
Manage episode 501503821 series 3585666
Content provided by Patrick McKenzie. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Patrick McKenzie or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.
This week on Complex Systems, Patrick McKenzie (patio11) is joined by Joel Becker from METR. They discuss groundbreaking research on AI coding assistants.
Joel et al’s randomized controlled trial of 16 expert developers working on major open source projects revealed a counterintuitive finding: despite predictions of 24-40% speed improvements, developers actually took 19% longer to complete tasks when using AI tools, even though they retrospectively believed they were 20% faster. The conversation explores why even sophisticated professionals struggle to accurately assess their own productivity with AI tools, the industrial organization of software development, and the implications for AI's recursive self-improvement in research and development. It also touches on other perspectives from software developers using these tools professionally, and where we can expect them to improve rapidly.
–
Full transcript available here: www.complexsystemspodcast.com/the-great-developer-speed-up-with-joel-becker/
–
Sponsor:
This episode is brought to you by Mercury, the fintech trusted by 200K+ companies — from first milestones to running complex systems. Mercury offers banking that truly understands startups and scales with them. Start today at Mercury.com
Mercury is a financial technology company, not a bank. Banking services provided by Choice Financial Group, Column N.A., and Evolve Bank & Trust; Members FDIC.
–
Recommended in this episode:
- METR: https://metr.org/
- Joel Becker’s site: https://joel-becker.com/
–
Timestamps:
(00:00) Intro
(00:34) Understanding AI evaluation methods
(02:04) METR's unique approach to AI evaluation
(03:10) The evolution of AI capabilities
(06:44) AI as coding assistants
(09:15) Research on AI's impact on developer productivity
(13:55) Sponsor: Mercury
(15:07) Challenges in measuring developer productivity
(20:38) Insights from the research paper
(31:26) The formalities of software development
(32:07) Automated tools and human discussions
(32:47) AI and style transfer in software
(34:35) The role of comments in AI coding
(36:51) The future of AI in software engineering
(40:25) Economic implications of AI in software
(46:53) Challenges and risks of AI in software
(59:03) Security concerns with AI-generated code
(01:04:59) Wrap
58 episodes
Share
Manage episode 501503821 series 3585666
Content provided by Patrick McKenzie. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Patrick McKenzie or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.
This week on Complex Systems, Patrick McKenzie (patio11) is joined by Joel Becker from METR. They discuss groundbreaking research on AI coding assistants.
Joel et al’s randomized controlled trial of 16 expert developers working on major open source projects revealed a counterintuitive finding: despite predictions of 24-40% speed improvements, developers actually took 19% longer to complete tasks when using AI tools, even though they retrospectively believed they were 20% faster. The conversation explores why even sophisticated professionals struggle to accurately assess their own productivity with AI tools, the industrial organization of software development, and the implications for AI's recursive self-improvement in research and development. It also touches on other perspectives from software developers using these tools professionally, and where we can expect them to improve rapidly.
–
Full transcript available here: www.complexsystemspodcast.com/the-great-developer-speed-up-with-joel-becker/
–
Sponsor:
This episode is brought to you by Mercury, the fintech trusted by 200K+ companies — from first milestones to running complex systems. Mercury offers banking that truly understands startups and scales with them. Start today at Mercury.com
Mercury is a financial technology company, not a bank. Banking services provided by Choice Financial Group, Column N.A., and Evolve Bank & Trust; Members FDIC.
–
Recommended in this episode:
- METR: https://metr.org/
- Joel Becker’s site: https://joel-becker.com/
–
Timestamps:
(00:00) Intro
(00:34) Understanding AI evaluation methods
(02:04) METR's unique approach to AI evaluation
(03:10) The evolution of AI capabilities
(06:44) AI as coding assistants
(09:15) Research on AI's impact on developer productivity
(13:55) Sponsor: Mercury
(15:07) Challenges in measuring developer productivity
(20:38) Insights from the research paper
(31:26) The formalities of software development
(32:07) Automated tools and human discussions
(32:47) AI and style transfer in software
(34:35) The role of comments in AI coding
(36:51) The future of AI in software engineering
(40:25) Economic implications of AI in software
(46:53) Challenges and risks of AI in software
(59:03) Security concerns with AI-generated code
(01:04:59) Wrap
58 episodes
All episodes
×
Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.
Similar to Complex Systems with Patrick McKenzie (patio11)
Bitcoin pioneer Charlie Shrem peels back the layers on the lives and backgrounds of the world's most impactful innovators. Centering around intimate narratives, Shrem uncovers a detailed, previously unspoken story of the genesis and evolution of bitcoin, cryptocurrency, artificial intelligence, and the web3 movements. Join Shrem as he journeys through the uncharted territories of tech revolutions, revealing the human side of the stories that shaped the digital world we live in today.
…
continue reading
Best Business Podcast (Gold), British Podcast Awards 2023 How do you build a fully electric motorcycle with no compromises on performance? How can we truly experience what the virtual world feels like? What does it take to design the first commercially available flying car? And how do you build a lightsaber? These are some of the questions this podcast answers as we share the moments where digital transforms physical, and meet the brilliant minds behind some of the most innovative products a ...
…
continue reading
Matching real people, asking real questions about their money, with experienced Financial Advisors. You’ll hear answers to important questions like: Is now the right time to buy a house? What to do if your business fails? How should I be saving to cover the cost of college? How much do I really need to retire and am I on track? Join us as our guests share their stories around life's major moments. And hear the difference a conversation can make. Hosted by Morgan Stanley Wealth Management’s J ...
…
continue reading
The show that helps you maximize your wealth by turning complex financial situations into actionable advice. On Your Money. Your Mission., we answer the questions you’ve been asking about -- financial planning, investing, retirement and everything in between. Whether you’re navigating the complexities of the market or looking for the best ways to save or spend your money, tune in to hear from experienced financial advisors with JFG. Walk away from each episode with savvy tips and financial t ...
…
continue reading
Capitalmind looks at stocks, bonds, funds and the macro to bring you their view on the Indian financial markets. We discuss all things related to investing at our focussed podcast that keeps it simple. For more, go to capitalmind.in and to invest with us, visit capitalmindwealth.com
…
continue reading
Big tech is transforming every aspect of our world. But how, and at what cost? This season of Land of the Giants – The Disney Dilemma – focuses on Disney’s ability to weather the ups and downs of the business cycle and changing tastes and explores what has kept it successful for over 100 years. The entertainment giant has leveraged nostalgia and its intellectual property to build a beloved brand, but after an acquisition spree that included Marvel, Lucasfilm, and 20th Century Fox, can it sus ...
…
continue reading
An archive of each full weekday episode of the award-winning program presented by Stephen Grootes.
…
continue reading
Decoder is a show from The Verge about big ideas — and other problems. Verge editor-in-chief Nilay Patel talks to a diverse cast of innovators and policymakers at the frontiers of business and technology to reveal how they’re navigating an ever-changing landscape, what keeps them up at night, and what it all means for our shared future.
…
continue reading
A podcast for developers interested in building great software products. Every episode, Adam Wathan is joined by a guest to talk about everything from product design and user experience to unit testing and system administration.
…
continue reading
Save more and spend less is more than just a motto for money expert Clark Howard; it’s a way of life. Clark and his crew — Team Clark — are on a mission to empower people to take control of their personal finances by providing money-saving tips, consumer advice, hot deals and economic news to help everyone achieve financial freedom. Clark is a nationally syndicated radio talk show host and a consumer reporter for television stations around the country. His podcast, The Clark Howard Show, rec ...
…
continue reading
Player FM - Podcast App
Go offline with the Player FM app!
Go offline with the Player FM app!
