Is SRE The Antidote To Developers Behaving Badly? With BobbyD Test Case Scenario podcast

34:40

Send us a text In this LIVE episode of Test Case Scenario , host Jason Baum, along with co-hosts Marcus Merrell and Evelyn Coleman, engages in a compelling conversation with Angie Jones, Global Vice President of Developer Relations, Block, Inc. They delve into the transformative impact of agentic AI and Model Context Protocols (MCPs) on software development and testing. Angie shares insights from her recent presentation at the Selenium and Appium Conference, discussing how AI agents are evolving from mere code assistants to autonomous entities capable of writing and executing tests. The discussion covers the practical applications of MCPs, the ethical considerations of AI in testing, and the future role of QA professionals in an AI-driven landscape. Topics Covered: Understanding agentic AI and MCPs Real-world applications of AI in test automation Ethical implications and the necessity of human oversight The evolving role of testing professionals Preparing for an AI-integrated future in software testing Guest Bio: Angie Jones is a globally recognized technologist, inventor, and speaker, currently serving as the VP of Developer Relations at TBD. With a rich background in test automation and a passion for AI, Angie is at the forefront of exploring how emerging technologies can redefine software development practices. Links & Resources: Angie Jones’ MCP for Selenium Project Angie’s Presentation at Selenium and Appium Conference More information on Angie…

1
Testing in 2025: AI, Automation & the Evolution of QA Leadership 30:15

19 days ago30:15

30:15

Send us a text In this episode of Test Case Scenario, host Jason Baum, along with co-hosts Marcus Merrell and Evelyn Coleman, sit down with Nithin S.S., Head of QA at Lodgify and founder of Synapse QA, to explore the rapidly evolving landscape of software testing in 2025. They discuss how AI is transforming QA processes, the growing importance of continuous testing, and the strategic implementation of Shift Left and Shift Right methodologies. The conversation also highlights the challenges and opportunities in building quality-first engineering teams in an era when automation and AI are becoming integral to software development. Join us as we discuss: • The impact of AI on test automation and QA workflows • Strategies for implementing continuous testing effectively • Balancing Shift Left and Shift Right testing approaches • Leadership insights for fostering a quality-centric culture Whether you’re a QA professional, developer, or tech leader, this episode offers valuable perspectives on navigating the future of software testing. We’d love to hear from you! Share your thoughts in the comments below or at community-hub@saucelabs.com. SUBSCRIBE today! Sign up for a free account and start running tests today at https://saucelabs.com/. ▶ Sauce YouTube channel: / @SauceLabs_Official 💡 LinkedIn: / https://www.linkedin.com/company/sauce-labs/ 🐦 X: / @saucelabs…

1
Rethinking AI’s Role in Leadership, Governance, and Productivity 19:46

13 weeks ago19:46

19:46

Send us a text AI is reshaping development, but is it meeting expectations? In this episode of Test Case Scenario, Jason Baum and Marcus Merrell explore the evolving role of AI in software development, drawing insights from recent industry reports. They discuss whether AI tools are living up to their promise of reducing burnout and boosting productivity while examining the complexities of debugging, security risks, and governance gaps. Join the conversation as they share fresh perspectives on how AI tools are reshaping workflows, the real challenges facing engineering leaders, and the steps developers can take to use AI more effectively and responsibly. Join us as we discuss: (00:00) Introduction (01:32) Exploring the DORA Report and AI in software development (03:34) The impact of AI on developer productivity and burnout (07:28) Governance challenges in adopting AI-generated code (10:23) Leadership strategies for rolling out AI tools effectively (14:16) The evolution of AI and the hype vs. reality debate (17:39) Reflecting on AI’s future role in software development We’d love to hear from you! Share your thoughts in the comments below or at community-hub@saucelabs.com. SUBSCRIBE and visit us at https://saucelabs.com/community to dig into the power of testing in software development. Sign up for a free account and start running tests today at https://saucelabs.com/. ▶ Sauce YouTube channel: / saucelabs 💡 LinkedIn: / sauce-labs 🐦 X: / saucelabs…

1
Business Resilience Test Strategies for 2025 47:44

14 weeks ago47:44

47:44

Send us a text Is your testing strategy ready for 2025? In this episode of Test Case Scenario, Jason Baum is joined by Maaret Pyhäjärvi , Principal Test Consultant at CGI , along with Diego Molina and Titus Fortner from Sauce Labs , to discuss the evolving landscape of quality assurance and business resilience. The panel delivers insights into the biggest challenges and opportunities for testing teams in 2025, from AI-assisted automation to the growing importance of accessibility testing. You’ll also hear insights on balancing efficiency with velocity, shifting team roles, and how organizations can adapt their QA strategies to keep pace with rapid innovation. Join us as we discuss: (00:00) Introduction (02:52) The role of AI in modern testing (03:59) Accessibility testing and the EAA deadline (05:29) Prioritizing efficiency over speed in 2025 (07:28) Who owns quality? The debate continues (08:36) AI as a tool for exploratory testing (10:41) Integrating AI into test automation (12:04) How testers are adapting to AI-generated code (17:53) Managing risk and compliance across industries (21:39) Continuous delivery vs. quality trade-offs (25:24) Measuring success: what really matters (30:31) AI’s impact on collaboration and team dynamics (35:46) Balancing risk tolerance and release velocity (38:48) The industry shift toward AI-assisted test strategy (44:11) Testing best practices across global markets We’d love to hear from you! Share your thoughts in the comments below or at community-hub@saucelabs.com. SUBSCRIBE and visit us at https://saucelabs.com/community to dig into the power of testing in software development. Sign up for a free account and start running tests today at https://saucelabs.com/. ▶ Sauce YouTube channel: / saucelabs 💡 LinkedIn: / sauce-labs 🐦 X: / saucelabs…

1
AI Promised to Boost Productivity—Did It Deliver? 28:05

15 weeks ago28:05

28:05

Send us a text Are AI tools really helping developers, or are they creating more problems than they solve? In this episode of Test Case Scenario, Jason Baum , Marcus Merrel , and Evelyn Coleman are joined by Titus Fortner , Senior Solutions Architect at Sauce Labs , to unpack the surprising findings from the latest DORA report . Together, they dive into the unexpected decline in productivity following AI adoption and discuss the challenges developers face in balancing automation, innovation, and collaboration. You’ll also hear their thoughts on the future of software development, the risks of over-relying on AI, and how teams can rethink their strategies to fully harness the potential of these powerful tools. Join us as we discuss: (00:00) AI Integration Hampers Productivity: DORA 2024 (03:49) Rapid Evaluation of Tech Tool Impact (06:41) AI Development: Prioritizing Maintenance Over Writing (09:26) AI Enhancing Developer Productivity (17:17) AI as Junior Developer Assistant (22:24) Embrace Testing in AI Era (25:02) Rethinking AI's Impact on UI (26:21) Emily Freeman's AI Warships Talk We’d love to hear from you! Share your thoughts in the comments below or at community-hub@saucelabs.com. SUBSCRIBE and visit us at https://saucelabs.com/community to dig into the power of testing in software development. Sign up for a free account and start running tests today at https://saucelabs.com/. ▶ Sauce YouTube channel: / saucelabs 💡 LinkedIn: / sauce-labs 🐦 X: / saucelabs…

1
Is AI Living Up to the Hype? A Retrospective Look from Industry Experts 19:30

17 weeks ago19:30

19:30

Send us a text AI has made waves in testing, but how much has really changed? In this episode of Test Case Scenario, Jason Baum, Evelyn Coleman , and Marcus Merrell take a critical look at the progress of AI in software testing. They discuss the real capabilities of tools like ChatGPT and Copilot, what’s improved over time, and what still leaves testers frustrated. You’ll also hear insights into how AI tools are shaping software development workflows, why cost and sustainability are becoming bigger concerns, and what testers can do to separate AI hype from practical solutions. Join us as we discuss: (00:00) Introduction (02:01) Evelyn’s approach to testing New Year’s resolutions (03:47) Revisiting ChatGPT: AI’s evolution and current limitations (05:43) The realities of AI costs and challenges in adoption (08:11) Improvements in AI-generated content and usability (10:53) Rediscovering AI tools for personal and professional use (16:38) The future of AI in daily life and automation potential We’d love to hear from you! Share your thoughts in the comments below or at community-hub@saucelabs.com. SUBSCRIBE and visit us at https://saucelabs.com/community to dig into the power of testing in software development. Sign up for a free account and start running tests today at https://saucelabs.com/. ▶ Sauce YouTube channel: / saucelabs 💡 LinkedIn: / sauce-labs 🐦 X: / saucelabs…

1
Building Quality as a Shared Responsibility with Rémy Gronencheld 38:29

18 weeks ago38:29

38:29

Send us a text Is your QA strategy keeping up with the speed of innovation? In this episode of Test Case Scenario, Jason Baum and Marcus Merrell are joined by Rémy Gronencheld , Quality Assurance Manager at BlaBlaCar , to explore how the global carpooling platform scaled from manual testing to seamless automation. Rémy dives into BlaBlaCar’s journey—moving from Mac minis and manual regressions to a robust, scalable test automation suite with Sauce Labs. You’ll also hear how BlaBlaCar’s “Q as a Service” model is redefining quality as a shared responsibility across teams. Join us as we discuss: (00:00) Introduction (02:07) Carpooling, community, and connections (05:47) The early days of testing: manual processes and Mac minis (08:52) Transitioning from manual testing to automation with Sauce Labs (10:08) Scaling automation and improving test coverage (12:17) How Sauce Labs transformed testing workflows and reduced maintenance (17:15) Tackling global challenges (21:22) Why quality goes beyond the app and into the car experience (22:58) Shifting left, shifting right, and finding the right balance for QA (25:10) Enabling shared responsibility for quality (28:06) Using data, metrics, and SLOs to track quality and performance (32:39) Building a culture of quality (35:43) Supporting teams with QA expertise (37:04) Adapting QA strategies to team needs and product maturity (37:37) How BlaBlaCar’s testing journey saves time and builds trust (38:24) The future of quality at BlaBlaCar We’d love to hear from you! Share your thoughts in the comments below or at community-hub@saucelabs.com. SUBSCRIBE and visit us at https://saucelabs.com/community to dig into the power of testing in software development. Sign up for a free account and start running tests today at https://saucelabs.com/. ▶ Sauce YouTube channel: / saucelabs 💡 LinkedIn: / sauce-labs 🐦 X: / saucelabs…

1
How Quality Testing Drives Business Growth 29:08

19 weeks ago29:08

29:08

Send us a text Escaped bugs can break more than your code—they can break the bank, too. In this episode of Test Case Scenario , Jason Baum, Evelyn Coleman , and Marcus Merrell break down the connection between software quality and business impact. They talk about how to approach postmortems, why some features matter more than others, and how technical teams can align their work with business goals. You’ll also hear real-life stories of bugs that cost companies millions and learn practical tips for balancing technical needs with business priorities in industries like retail, finance, healthcare, and government. Join us as we discuss: (00:00) Introduction (01:26) The economic impact of testing and quality failures (02:30) Bridging the gap between technical and business priorities (04:18) Examples of costly bugs and lessons learned (06:50) Building trust through proactive testing strategies (09:39) Testing challenges for retail, finance, and healthcare (13:17) Prioritizing workflows and key takeaways for testers (20:38) The importance of accessibility and integration testing (27:47) Looking ahead to 2025 We’d love to hear from you! Share your thoughts in the comments below or at community-hub@saucelabs.com. SUBSCRIBE and visit us at https://saucelabs.com/community to dig into the power of testing in software development. Sign up for a free account and start running tests today at https://saucelabs.com/. ▶ Sauce YouTube channel: / saucelabs 💡 LinkedIn: / sauce-labs 🐦 X: / saucelabs…

1
Beyond Selenium: Choosing the Right Library for Your Testing 43:24

22 weeks ago43:24

43:24

Send us a text Is Selenium still the best choice for your test automation needs? In this episode of Test Case Scenario, Jason Baum sits down with Diego Molina , Staff Software Engineer for Open Source & Community at Sauce Labs, to unpack the complexities of selecting the right testing framework. They discuss the evolution of Selenium, the rise of modern tools like Playwright and Cypress, and the nuances of browser automation standards like WebDriver and CDP. You’ll also hear about the hidden pitfalls of building custom frameworks, how collaboration is shaping the future of automation, and why focusing on value-driven testing is the key to long-term success. Join us as we discuss: (00:00) Introduction (01:12) Choosing the right testing framework (04:46) The pros and cons of Selenium for modern automation (07:35) You can’t compare Selenium, Playwright, and Cypress (13:01) High-level vs. low-level approaches to browser automation (16:20) The evolution of browser automation: CDP vs. WebDriver (23:16) The importance of collaboration in the testing community (20:53) Standardization and the future of cross-browser automation (27:08) Reducing maintenance costs with modern test frameworks (30:09) Recommendations for Java, Python, Ruby, and JavaScript frameworks (38:14) Predictions for Playwright and the rise of WebDriver BiDi (40:49) Key takeaways for choosing the best testing framework We’d love to hear from you! Share your thoughts in the comments below or at community-hub@saucelabs.com. SUBSCRIBE and visit us at https://saucelabs.com/community to dig into the power of testing in software development. Sign up for a free account and start running tests today at https://saucelabs.com/. ▶ Sauce YouTube channel: / saucelabs 💡 LinkedIn: / sauce-labs 🐦 X: / saucelabs…

1
Key Predictions for Tech and Software Testing Trends in 2025 25:46

23 weeks ago25:46

25:46

Send us a text What’s next for software testing in 2025? In this episode of Test Case Scenario , Jason Baum, Evelyn Coleman , and Marcus Merrell discuss the trends shaping the future of testing. From AI advancements to accessibility regulations, they explore what’s on the horizon for testing tools and methodologies. The conversation covers everything from the ongoing shift left versus shift right debate to the growing importance of testing beyond QA, including security, onboarding, and customer experiences. You’ll also hear their predictions on how low-code tools, edge-case testing, and emerging technologies like quantum computing could impact the industry. Join us as we discuss: (00:00) Introduction (03:50) Emerging trends in software testing for 2025 (04:45) Testing beyond QA boundaries (06:40) The rise of low-code tools and their impact on testing (07:18) Prediction on quality emphasis in software testing (09:03) AI advancements and challenges in real-world applications (11:03) Risk reduction and change management trends for testing (12:55) The state of shift left and its evolution in the industry (14:57) Shifting right and testing in production scenarios (17:13) The importance of context in choosing testing strategies (20:39) Accessibility testing driven by new regulations (21:45) Quantum computing in testing—hype or reality? (22:32) Ethical AI testing and its scalability challenges We’d love to hear from you! Share your thoughts in the comments below or at community-hub@saucelabs.com. SUBSCRIBE and visit us at https://saucelabs.com/community to dig into the power of testing in software development. Sign up for a free account and start running tests today at https://saucelabs.com/ ▶ Sauce YouTube channel: / saucelabs 💡 LinkedIn: / sauce-labs 🐦 X: / saucelabs…

1
Error Monitoring Across the SDLC with Mac Clark 29:39

24 weeks ago29:39

29:39

Send us a text Can your software handle the pressure when bugs slip through the cracks? In this episode of Test Case Scenario, Jason Baum and Evelyn Coleman chat with Mac Clark , Senior Solutions Engineer at Sauce Labs , about the dynamic world of shift-left and shift-right testing. Mac shares how gaming and software industries leverage AI-driven testing, real-time error monitoring, and feature flags to catch issues before they snowball into costly problems in production. You’ll also learn the hidden risks of neglecting continuous testing and how to protect your brand’s reputation by balancing proactive and reactive testing strategies. Join us as we discuss: (00:00) Introduction (01:12) Shift-right testing v. shift-left testing (03:32) The role of error reporting in continuous quality (06:50) Balancing shift-left and shift-right without cutting corners (10:06) Using AI-driven testing to reduce developer crunch (13:46) How Backtrace and real-time error monitoring can save production (17:48) Crash and error reporting in gaming (20:41) Avoiding alert fatigue and prioritizing critical errors (24:01) Scaling error monitoring for large-scale software releases (27:56) Lightning round We’d love to hear from you! Share your thoughts in the comments below or at community-hub@saucelabs.com. SUBSCRIBE and visit us at https://saucelabs.com/community to dig into the power of testing in software development. Sign up for a free account and start running tests today at https://saucelabs.com/. ▶ Sauce YouTube channel: / saucelabs 💡 LinkedIn: / sauce-labs 🐦 X: / saucelabs…

1
Accelerating Software Quality through Rapid Feedback with Titus Fortner 32:43

26 weeks ago32:43

32:43

Send us a text What’s the secret to optimizing your test suite without sacrificing quality? In this episode of Test Case Scenario, Jason Baum and Evelyn Coleman are joined by Titus Fortner , Senior Developer Experience Engineer at Sauce Labs , to discuss strategies for improving CI pipelines, tackling test flakiness, and using analytics to streamline the testing process. Get insights on how Sauce Labs prioritizes speed, coverage, and reliability in large-scale testing across multiple environments. You’ll also learn real-world solutions to help teams stay agile while ensuring software quality. Join us as we discuss: (00:00) Introduction (02:33) Scenario 1: Dealing with a slow CI pipeline caused by too many tests (05:27) Scenario 2: Sorting always-failing vs. intermittently-failing tests using analytics (07:10) Scenario 3: Managing a critical bug in production and prioritizing tests (12:19) Scenario 4: Prioritizing test cases for feature rollouts across regions (17:49) Scenario 5: Using analytics to track real-time performance issues across regions (22:45) Scenario 6: Using data analytics in day-to-day testing and uncovering hidden pitfalls (26:25) Titus’ advice for QA managers and the evolving role of testing We’d love to hear from you! Share your thoughts in the comments below or at community-hub@saucelabs.com. SUBSCRIBE and visit us at https://saucelabs.com/community to dig into the power of testing in software development. Sign up for a free account and start running tests today at https://saucelabs.com/. ▶ Sauce YouTube channel: / saucelabs 💡 LinkedIn: / sauce-labs 🐦 X: / saucelabs…

1
Improving DevOps Maturity with Continuous Testing with DevOps Legend Marc Hornbeek 38:16

27 weeks ago38:16

38:16

Send us a text Continuous testing isn't just about automation—it's about strategy, feedback, and getting your team unstuck. In today’s episode, Jason Baum and Marcus Merrell are joined by former co-host, Evelyn Coleman , to welcome Marc Hornbeek on the show. If you’re not familiar with Marc, he’s a legend in the world of DevOps. The author of “Continuous Testing, Quality Security and Feedback,” and CEO and Principal Consultant of Engineering DevOps Consulting , he knows what it takes to succeed in the industry. Marc draws from decades of hands-on experience to highlight the crucial role of continuous testing and feedback in accelerating an organization's journey to DevOps maturity. He also shares the inspiration behind his latest book and offers actionable strategies for overcoming common roadblocks and advancing testing and DevOps practices. Join us as we discuss: (00:00) Introduction (03:30) The feedback aspects of DevOps (06:55) Challenges organizations face when scaling DevOps (10:45) The evolution of testing in DevOps (14:44) Understanding the role of QA in complex products (19:20) Practical strategies for continuous testing and feedback (22:51) The uses and misuses of Gen AI in testing (28:18) The AI blueprint for continuous testing (31:13) Emerging trends in continuous testing and automation (36:05) Preview of Marc’s next book on AI-assisted security We’d love to hear from you! Share your thoughts in the comments below or at community-hub@saucelabs.com. SUBSCRIBE and visit us at https://saucelabs.com/community to dig into the power of testing in software development. Sign up for a free account and start running tests today at https://saucelabs.com/. ▶ Sauce YouTube channel: / saucelabs 💡 LinkedIn: / sauce-labs 🐦 X: / saucelabs…

1
Shaping the Future of QA: Strategic Insights for Leadership in a Shifting Job Market 38:42

28 weeks ago38:42

38:42

Send us a text AI is here, but does that mean the end of QA as we know it? In this episode of Test Case Scenario, Jason Baum and Marcus Merrell are joined by Jenna Charlton , a QA Testing Expert and Product Manager. With AI and automation transforming the industry, Jenna shares how these technologies are reshaping QA roles and what testers can do to stay ahead in a rapidly changing job market. Jenna also shares her thoughts on why manual testers still matter, the value of specialization in QA, and how leaders can ensure their teams are equipped for the future. You’ll also hear insights on balancing human expertise with automation and why QA needs to take a bigger seat at the decision-making table. Join us as we discuss: (00:00) Intro (02:10) The state of the QA job market and layoffs (07:45) Crowstrike incident and taking quality for granted (11:00) How QA has evolved and the shift in skills over the last decade (19:37) Strategies for building agile and adaptable QA teams (21:58) Impact of remote work and global collaboration on QA hiring (23:13) Importance of security in QA processes (31:20) Predictions for the future of QA and industry trends (34:11) The importance of junior testers and their role in QA teams We’d love to hear from you! Share your thoughts in the comments below or at community-hub@saucelabs.com. SUBSCRIBE and visit us at https://saucelabs.com/community to dig into the power of testing in software development. Sign up for a free account and start running tests today at https://saucelabs.com/. ▶ Sauce YouTube channel: / saucelabs 💡 LinkedIn: / sauce-labs 🐦 X: / saucelabs…

1
Building Reliable Software Systems with DoorDash's Saurabh Shanbhag 32:28

31 weeks ago32:28