83 subscribers
Go offline with the Player FM app!
How fitness functions can help us govern and measure AI
Manage episode 469913335 series 2602635
AI is inherently dynamic: that's true in terms of the field itself, and at a much lower level too — models are trained on new data and algorithms adapt and change to new circumstances and information. That's part of its power and what makes it so exciting, but from a business and organizational perspective, that can make governance and measurement exceptionally difficult. How can we know that our AI is optimized for the right thing? How can we be sure it's oriented towards what we want it to be?
This is where the concept of fitness functions can help. Broadly speaking, fitness functions are ways of measuring the extent to which a given solution is fulfilling its goals — so, in the context of AI, they can help teams ensure that AI systems are serving their intended purpose.
In this episode of the Technology Podcast, Rebecca Parsons and Neal Ford — authors (alongside Pat Kua and Pramod Sadalage) of Building Evolutionary Architectures, the book which brought fitness functions into the software architecture space — join host Ken Mugrage to explore how the fitness function concept can help us better manage the dynamism of AI and, in doing so, overcome the challenge of bringing such systems into production.
Learn more about Building Evolutionary Architectures: https://www.thoughtworks.com/insights/books/building-evolutionaryarchitectures-second-edition
140 episodes
Manage episode 469913335 series 2602635
AI is inherently dynamic: that's true in terms of the field itself, and at a much lower level too — models are trained on new data and algorithms adapt and change to new circumstances and information. That's part of its power and what makes it so exciting, but from a business and organizational perspective, that can make governance and measurement exceptionally difficult. How can we know that our AI is optimized for the right thing? How can we be sure it's oriented towards what we want it to be?
This is where the concept of fitness functions can help. Broadly speaking, fitness functions are ways of measuring the extent to which a given solution is fulfilling its goals — so, in the context of AI, they can help teams ensure that AI systems are serving their intended purpose.
In this episode of the Technology Podcast, Rebecca Parsons and Neal Ford — authors (alongside Pat Kua and Pramod Sadalage) of Building Evolutionary Architectures, the book which brought fitness functions into the software architecture space — join host Ken Mugrage to explore how the fitness function concept can help us better manage the dynamism of AI and, in doing so, overcome the challenge of bringing such systems into production.
Learn more about Building Evolutionary Architectures: https://www.thoughtworks.com/insights/books/building-evolutionaryarchitectures-second-edition
140 episodes
All episodes
×
1 Caring about documentation in the LLM era (w/ Heidi Waterhouse) 39:19

1 Why the tech industry needs Expert Generalists (w/ Martin Fowler) 43:21

1 The three new fallacies of distributed computing 46:56

1 MCP and SRE: Why the future of IT operations is agent-driven 28:33

1 Accelerating mainframe modernization using generative AI 38:28

1 Exploring the fundamentals of software engineering 27:51

1 How fitness functions can help us govern and measure AI 42:01

1 Exploring the intersections of software architecture 43:32

1 Who should make software architecture decisions? 35:00

1 Generative AI's uncanny valley: Problem or opportunity? 28:51

1 Using generative AI for legacy modernization 33:19

1 Data contracts: What are they and why do they matter? 37:38

1 In conversation with Thomas Squeo, Thoughtworks CTO for the Americas 33:09


1 Build Your Own Radar: Using the Technology Radar as a governance tool 37:11

1 Exploring DuckDB: A relational database built for online analytical processing 35:26

1 Software service granularity: Getting it right 43:38



1 Sensible defaults: A way to think about our technology practices 40:06

1 Tracking technology stacks, practices and experiences across teams 36:59

1 Inside Bahmni: An open-source digital public good 52:11

1 How to assess your organization's security maturity 40:01
Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.