#116: AI Agents, MCP And The Problems With AI Benchmarks | Ft. Matt Carey Real World Serverless With Theburningmonk podcast

Real World Serverless with theburningmonk

26:46

For many travelers, Antarctica is a bucket-list destination, a once-in-a-lifetime opportunity to touch all seven continents. In 2023, a record-breaking 100,000 tourists made the trip. But the journey begs a fundamental question: What do we risk by traveling to a place that is supposed to be uninhabited by humans? And as the climate warms, should we really be going to Antarctica in the first place? SHOW NOTES: Kara Weller: The Impossible Dilemma of a Polar Guide Marilyn Raphael: A twenty-first century structural change in Antarctica’s sea ice system Karl Watson: First Time in Antarctica Jeb Brooks : 7 Days in Antarctica (Journey to the South Pole) Metallica - Freeze 'Em All: Live in Antarctica Learn about your ad choices: dovetail.prx.org/ad-choices…

Real World Serverless with theburningmonk »
#116: AI Agents, MCP and the problems with AI benchmarks | ft. Matt Carey

10 days ago 48:08

MP3•Episode home

In this episode, I spoke with Matt Carey, founding AI engineer at StackOne, founder of AI Demo Days and member of the OpenUK AI Advisory Board.

Everyone needs a friend who works in AI to help them filter the AI news and get the signals from the noise. Matt is that friend for me!

We discussed AI agents, MCP, and the challenges of AI benchmarks, which help explain the disconnect between the benchmark results and the anecdotal experiences of AI users, such as myself.

Links from the episode:

Opening theme song:
Cheery Monday by Kevin MacLeod
Link: https://incompetech.filmmusic.io/song/3495-cheery-monday
License: http://creativecommons.org/licenses/by/4.0

115 episodes

#Tech #Yan Cui

#116: AI Agents, MCP and the problems with AI benchmarks | ft. Matt Carey

30 subscribers

published 10 days ago

MP3•Episode home

In this episode, I spoke with Matt Carey, founding AI engineer at StackOne, founder of AI Demo Days and member of the OpenUK AI Advisory Board.

Everyone needs a friend who works in AI to help them filter the AI news and get the signals from the noise. Matt is that friend for me!

We discussed AI agents, MCP, and the challenges of AI benchmarks, which help explain the disconnect between the benchmark results and the anecdotal experiences of AI users, such as myself.

Links from the episode:

Opening theme song:
Cheery Monday by Kevin MacLeod
Link: https://incompetech.filmmusic.io/song/3495-cheery-monday
License: http://creativecommons.org/licenses/by/4.0

115 episodes

#Tech #Yan Cui

All episodes

Real World Serverless with theburningmonk

1
#116: AI Agents, MCP and the problems with AI benchmarks | ft. Matt Carey 48:08

10 days ago48:08

48:08

In this episode, I spoke with Matt Carey, founding AI engineer at StackOne, founder of AI Demo Days and member of the OpenUK AI Advisory Board. Everyone needs a friend who works in AI to help them filter the AI news and get the signals from the noise. Matt is that friend for me! We discussed AI agents, MCP, and the challenges of AI benchmarks, which help explain the disconnect between the benchmark results and the anecdotal experiences of AI users, such as myself. Links from the episode: Google's whitepaper on AI agents Anthropic Building Effective AI Agents Simon Willison on X Thorsten Ball's Joy & Curiosity newsletter AI Demo Days MCP has a prompt injection problem Opening theme song: Cheery Monday by Kevin MacLeod Link: https://incompetech.filmmusic.io/song/3495-cheery-monday License: http://creativecommons.org/licenses/by/4.0…

Real World Serverless with theburningmonk

1
#115: Introducing LocalStack v4! 1:03:55

28 days ago1:03:55

1:03:55

In this episode, I spoke with Waldemar Hummer, founder and CTO of LocalStack. We discussed what's new in the latest version of LocalStack and highlighted some of the most interesting additions. One particular highlight for me is the ability to visualise and troubleshoot event-driven architectures end-to-end and quickly identify problems such as missing IAM permission. Lots of exciting new features in LocalStack v4! This episode include a live demo of LocalStack v4. To get the most from the demo, please watch the episode on YouTube here . Links from the episode: My conversation with Waldemar after LocalStack v3 LocalStack v4 announcement My blog post on when to use Step Functions vs running everything in Lambda Opening theme song: Cheery Monday by Kevin MacLeod Link: https://incompetech.filmmusic.io/song/3495-cheery-monday License: http://creativecommons.org/licenses/by/4.0…

Real World Serverless with theburningmonk

1
#114: Best practices for building a multi-tenant system with Khawaja Shams 48:24

7 weeks ago48:24

48:24

In this episode, I spoke with Khawaja Shams, co-founder of Momento, about cell-based architectures and how it allows Momento to scale to millions of transactions per second (TPS) while maintaining a healthy blast radius within their multi-tenant system. Links from the episode: Momento Khawaja on X Khawaja on LinkedIn Believe In Serverless community Opening theme song: Cheery Monday by Kevin MacLeod Link: https://incompetech.filmmusic.io/song/3495-cheery-monday License: http://creativecommons.org/licenses/by/4.…

Real World Serverless with theburningmonk

1
#113: Why you need Knowledge Graphs for your AI chatbot | ft. Aniket Mitra 45:13

12 weeks ago45:13

45:13

In this episode, I spoke with Aniket Mitra, founder of CW, to learn more about knowledge graphs and how they are making a comeback in the era of AI and LLMs. Opening theme song: Cheery Monday by Kevin MacLeod Link: https://incompetech.filmmusic.io/song/3495-cheery-monday License: http://creativecommons.org/licenses/by/4.…

Real World Serverless with theburningmonk

1
#112: Better Developer Experience for Event-Driven Architectures | ft. Alex Bouchard, co-founder of Hookdeck 59:18

13 weeks ago59:18

59:18

In this episode, I spoke with Alex Bouchard, co-founder and CTO of Hookdeck, to learn more about Hookdeck and how it differs from Amazon EventBridge. This episode contains a live demo of Hookdeck, for the best viewing experience, please watch the recording on YouTube here . Alex gave me a demo of Hookdeck, which has some nice features for addressing common developer experience problems with EventBridge. For example: Deliver events to local targets Audit history of event deliveries Issues page of failed event deliveries Replay failed events Links from the episode: Check out Hookdeck Opening theme song: Cheery Monday by Kevin MacLeod Link: https://incompetech.filmmusic.io/song/3495-cheery-monday License: http://creativecommons.org/licenses/by/4.…

Real World Serverless with theburningmonk

1
#111 - EventCatalog Revolutionizes Governance in Event-Driven Architectures | ft. David Boyne 51:00

15 weeks ago51:00

51:00

In this episode, I spoke with David Boyne, the creator of EventCatalog, to learn more about the most common challenges with Event-Driven Architectures and how EventCatalog can solve the governance problem - how events are versioned, schema'd, discovered and tested. This episode includes a short demo of EventCatalog, if you want to see the demo in action, then check out the video version on YouTube here . Links from the episode: EventCatalog Winglang Opening theme song: Cheery Monday by Kevin MacLeod Link: https://incompetech.filmmusic.io/song/3495-cheery-monday License: http://creativecommons.org/licenses/by/4.…

Real World Serverless with theburningmonk

1
#109: Building serverless apps in PHP with Bref | ft Matthieu Napoli 55:56

27 weeks ago55:56

55:56

Thank you to Momento for supporting this episode. Momento's real-time data platform empowers developers to build innovative products faster and more reliably than ever before. Visit gomomento.co/theburningmonk for more information. In this episode, I spoke with Matthieu Napoli about the Bref framework for developing serverless applications in PHP - how it works, why PHP and how it compares with Laravel Vapor. This episode includes a short demo of Bref, if you want to see the demo in action, then check out the video version on YouTube here . Links from the episode: Bref framework Opening theme song: Cheery Monday by Kevin MacLeod Link: https://incompetech.filmmusic.io/song/3495-cheery-monday License: http://creativecommons.org/licenses/by/4.…

Real World Serverless with theburningmonk

1
#108: Lambda on Rust with James Eastham 1:02:02

32 weeks ago1:02:02

1:02:02

Thank you to Hookdeck for sponsoring this episode. If you're looking to level-up your event-driven architecture, then check out their serverless event gateway at hookdeck.com/theburningmonk and help support this channel. James Eastham is a developer advocate at Datadog and co-author of "Crafting Lambda Functions in Rust". In this episode, we dive into writing Lambda functions in Rust and why you should invest in learning Rust. Links from the episode: NSA whitepaper on memory safety Julian Wood’s Lambda internals talk at re:Invent 2022 Jame's YouTube channel Crafting Lambda Functions in Rust Ep106 on middy with Luciano Mammino Ep97 on LLRT (the superfast JavaScript runtime for Lambda) Opening theme song: Cheery Monday by Kevin MacLeod Link: https://incompetech.filmmusic.io/song/3495-cheery-monday License: http://creativecommons.org/licenses/by/4.…

Real World Serverless with theburningmonk

1
#107: How to Have a Successful Cloud Career in 2024 | ft. Andrew Brown 52:33

35 weeks ago52:33

52:33

Thank you to Momento for supporting this episode. Momento's real-time data platform empowers developers to build innovative products faster and more reliably than ever before. Visit gomomento.co/theburningmonk for more information. I spoke with Andrew Brown, renowned educator in the cloud space, to get his take on how cloud learners can break into the cloud and forge a successful career. Links from the episode: Andrew's paid courses Andrew's free courses Andrew's AWS examples Opening theme song: Cheery Monday by Kevin MacLeod Link: https://incompetech.filmmusic.io/song/3495-cheery-monday License: http://creativecommons.org/licenses/by/4.0…

Real World Serverless with theburningmonk

1
#106: Rust with Lambda, easy-mode Rust & future of Middy | ft. Luciano Mammino 45:51

37 weeks ago45:51

45:51

Thank you to Hookdeck for sponsoring this episode. If you're looking to level-up your event-driven architecture, then check out their serverless event gateway at hookdeck.com/theburningmonk and help support this channel. AWS Serverless Hero Luciano Mammino shares the history of Middy, the popular middleware engine for AWS Lambda functions; why he's sold on writing Lambda functions in Rust and why you should too! Links from the episode: AWS Bites channel Middy How to sponsor Middy Crafting Lambda Functions in Rust Easy mode Rust Using Node.js ES modules and top-level await in AWS Lambda Using Middy with Typescript Ep97 on LLRT (the superfast JavaScript runtime for Lambda) Opening theme song: Cheery Monday by Kevin MacLeod Link: https://incompetech.filmmusic.io/song/3495-cheery-monday License: http://creativecommons.org/licenses/by/4.0…

Real World Serverless with theburningmonk

1
#105: The inception story of Cognito & secret to succeeding at AWS | ft. David Behroozi 1:14:51

40 weeks ago1:14:51

1:14:51

Thank you to Momento for supporting this episode. Momento's real-time data platform empowers developers to build innovative products faster and more reliably than ever before. Visit gomomento.co/theburningmonk for more information. David Behroozi, a 15-year Amazon veteran, tells us the inception story of Amazon Cognito and the cheat code for succeeding at AWS. He also gave us a demo of Speedrun, his latest project since leaving Amazon. It turns your GitHub markdown into executable blocks of code that remember your context (e.g. AWS account and region) so your runbook can be executed right from the markdown. I recommend watching the episode on YouTube so you can see the full demo: https://youtu.be/nhWYlzb8mSA Links from the episode: David's LinkedIn profile David's Twitter profile Learn more about Speedrun David's blog How to Securely let Frontend Apps to Directly Access AWS services Opening theme song: Cheery Monday by Kevin MacLeod Link: https://incompetech.filmmusic.io/song/3495-cheery-monday License: http://creativecommons.org/licenses/by/4.0…

Real World Serverless with theburningmonk

1
#104: Baseline, is this new serverless development framework better than Amplify? 57:49

41 weeks ago57:49

57:49

Thank you to Hookdeck for sponsoring this episode. If you're looking to level-up your event-driven architecture, then check out their serverless event gateway at hookdeck.com/theburningmonk and help support this podcast. Thomas Nixon, CTO of Baseline, shares stories from the trenches about the challenges of adopting serverless technologies. He gave us a demo of Baseline.js, a new serverless development framework that captures the many hard-learned lessons his team has made in the last six years. Think Amplify, but you own the source code and can easily customize things to suit your needs. I recommend watching the episode on YouTube so you can see the full demo: https://www.youtube.com/watch?v=a6r8M8E_5n4 Links from the episode: Getting started with Baseline.js Baseline's Github repo Thomas' LinkedIn profile Opening theme song: Cheery Monday by Kevin MacLeod Link: https://incompetech.filmmusic.io/song/3495-cheery-monday License: http://creativecommons.org/licenses/by/4.0…

Real World Serverless with theburningmonk

1
#103 - Community building, being an enable, is serverless dead? ft. Allen Helton 1:00:27

43 weeks ago1:00:27

1:00:27

Thank you to Hookdeck for sponsoring this episode. Please check them out and help support this podcast. Allen Helton on being an enabler, building communities, and is serverless dead? Links from the episode: Help Olivia's Fight Against Leukemia! Believe In Serverless community Ready, Set, Cloud! Momento, serverless cache Ep102: Peek behind the curtains of the AWS Heroes & Community Builders programmes, ft. Farrah Campbell Opening theme song: Cheery Monday by Kevin MacLeod Link: https://incompetech.filmmusic.io/song/3495-cheery-monday License: http://creativecommons.org/licenses/by/4.0…

Real World Serverless with theburningmonk

1
#102: Building AWS communities with Farrah Campbell 44:05

50 weeks ago44:05

44:05

Take a peek behind the AWS Heroes and Community Builders programmes with Farrah Campbell, who was a former AWS hero turned AWS employee. Nowadays, Farrah heads up both the AWS Heroes and Community Builders programmes. Links from the episode: How to become an AWS hero by Danielle Heberling S3 no longer charges for unauthorized requests AWS Heroes directory AWS Community Builders directory Opening theme song: Cheery Monday by Kevin MacLeod Link: https://incompetech.filmmusic.io/song/3495-cheery-monday License: http://creativecommons.org/licenses/by/4.0…

Real World Serverless with theburningmonk

1
#101: Faster serverless APIs with Brian LeRoux 1:00:19

1 year ago1:00:19