Best Yusuf Moolla Podcasts (2025)

1
Article 23. Algorithmic System Integrity: Testing 5:47

2M ago5:47

5:47

Spoken by a human version of this article. TL;DR (TL;DL?) Testing is a core basic step for algorithmic integrity. Testing involves various stages, from developer self-checks to UAT. Where these happen will depend on whether the system is built in-house or bought. Testing needs to cover several integrity aspects, including accuracy, fairness, securi…

1
Article 22. Algorithm Integrity: Third party assurance 7:26

3M ago7:26

7:26

Spoken by a human version of this article. One question that comes up often is “How do we obtain assurance about third party products or services?” Depending on the nature of the relationship, and what you need assurance for, this can vary widely. This article attempts to lay out the options, considerations, and key steps to take. TL;DR (TL;DL?) Th…

1
Guest 3. Shea Brown, Founder and CEO of BABL AI 41:23

3M ago41:23

41:23

Navigating AI Audits with Dr. Shea Brown Dr. Shea Brown is Founder and CEO of BABL AI BABL specializes in auditing and certifying AI systems, consulting on responsible AI practices, and offering online education. Shea shares his journey from astrophysics to AI auditing, the core services provided by BABL AI including compliance audits, technical te…

1
Article 21. AI Risk Training: Role-based tailoring 6:26

3M ago6:26

6:26

Spoken by a human version of this article. AI literacy is growing in importance (e.g., EU AI Act, IAIS). AI literacy needs vary across roles. Even "AI professionals" need AI Risk training. Links EU AI Act: The European Union Artificial Intelligence Act - specific expectation about “AI literacy”. IAIS: The International Association of Insurance Supe…

1
Guest 2. Patrick Sullivan: VP of Strategy and Innovation at A-LIGN 32:03

3M ago32:03

32:03

Navigating AI Governance and Compliance Patrick Sullivan is Vice President of Strategy and Innovation at A-LIGN and an expert in cybersecurity and AI compliance with over 25 years of experience. Patrick shares his career journey, discusses his passion for educating executives and directors on effective governance, and explains the critical role of …

1
Guest 1. Ryan Carrier: Executive Director of ForHumanity 44:49

3M ago44:49

44:49

Mitigating AI Risks Ryan Carrier is founder and executive director of ForHumanity, a non-profit focused on mitigating the risks associated with AI, autonomous, and algorithmic systems. With 25 years of experience in financial services, Ryan discusses ForHumanity's mission to analyze and mitigate the downside risks of AI to benefit society. The conv…

1
Article 20. Algorithm Reviews: Public vs Private Reports 8:26

4M ago8:26

8:26

Spoken (by a human) version of this article. Public AI audit reports aren't universally required; they mainly apply to high-risk applications and/or specific jurisdictions. The push for transparency primarily concerns independent audits, not internal reviews. Prepare by implementing ethical AI practices and conducting regular reviews. Note: High-ri…

1
Article 19. Algorithmic System Reviews: Substantive vs. Controls Testing 6:26

4M ago6:26

6:26

Spoken by a human version of this article. Knowing the basics of substantive testing vs. controls testing can help you determine if the review will meet your needs. Substantive testing directly identifies errors or unfairness, while controls testing evaluates governance effectiveness. The results/conclusions are different. Understanding these diffe…

1
Article 18. Algorithm Integrity: Training and Awareness 4:07

5M ago4:07

4:07

Spoken by a human version of this article. Ongoing education helps everyone understand their role in responsibly developing and using algorithmic systems. Regulators and standard-setting bodies emphasise the need for AI literacy across all organisational levels. Links ForHumanity - join the growing community here. ForHumanity - free courses here. I…

1
Article 17. Algorithm Integrity: Audit vs Review 9:10

5M ago9:10

9:10

Spoken by a human version of this article. The terminology – “audit” vs “review” - is important, but clarity about deliverables is more important when commissioning algorithm integrity assessments. Audits are formal, with an opinion or conclusion that can often be shared externally. Reviews come in various forms and typically produce recommendation…

1
Article 16. Algorithmic System Accuracy Reviews – Choosing the Right Approach 8:07

5M ago8:07

8:07

Spoken (by a human) version of this article. Outcome-focused accuracy reviews directly verify results, offering more robust assurance than process-focused methods. This approach can catch translation errors, unintended consequences, and edge cases that process reviews might miss. While more time-consuming and complex, outcome-focused reviews provid…

1
Article 15. Algorithm Integrity Documentation - Getting Started 5:19

5M ago5:19

5:19

Spoken (by a human) version of this article. Documentation makes it easier to consistently maintain algorithm integrity. This is well known. But there are lots of types of documents to prepare, and often the first hurdle is just thinking about where to start. So this simple guide is meant to help do exactly that – get going. About this podcast A po…

1
Article 14. External data - use with care 6:59

6M ago6:59

6:59

Spoken (by a human) version of this article. Banks and insurers are increasingly using external data; using them beyond their intended purpose can be risky (e.g. discriminatory). Emerging regulations and regulatory guidance emphasise the need for active oversight by boards, senior management to ensure responsible use of external data. Keeping the c…

1
Article 13. Bridging the purpose-risk gap: Customer-first algorithmic risk assessments 7:18

6M ago7:18

7:18

Spoken (by a human) version of this article. Banks and insurers sometimes lose sight of their customer-centric purpose when assessing AI/algorithm risks, focusing instead on regular business risks and regulatory concerns. Regulators are noticing this disconnect. This article aims to outline why the disconnect happens and how we can fix it. Report m…

1
Article 12. Risk-Focused Principles for Change Control in Algorithmic Systems 12:00

6M ago12:00

12:00

Spoken (by a human) version of this article. With algorithmic systems, an change can trigger a cascade of unintended consequences, potentially compromising fairness, accountability, and public trust. So, managing changes is important. But if you use the wrong framework, your change control process may tick the boxes, but be both ineffective and ine…

1
Article 11. Deprovisioning User Access to Maintain Algorithm Integrity 9:27

6M ago9:27

9:27

Spoken (by a human) version of this article. The integrity of algorithmic systems goes beyond accuracy and fairness. In Episode 4, we outlined 10 key aspects of algorithm integrity. Number 5 in that list (not in order of importance) is Security: the algorithmic system needs to be protected from unauthorised access, manipulation and exploitation. In…

1
Article 10. Fairness reviews: identifying essential attributes 6:54

7M ago6:54

6:54

Spoken (by a human) version of this article. When we're checking for fairness in our algorithmic systems (incl. processes, models, rules), we often ask: What are the personal characteristics or attributes that, if used, could lead to discrimination? This article provides a basic framework for identifying and categorising these attributes. About thi…

1
Article 9. Algorithmic Integrity: Don't wait for legislation 10:39

7M ago10:39

10:39

Spoken (by a human) version of this article. Legislation isn't the silver bullet for algorithmic integrity. Are they useful? Sure. They help provide clarity and can reduce ambiguity. And once a law is passed, we must comply. However: existing legislation may already apply new algorithm-focused laws can be too narrow or quickly outdated standards ca…

1
Article 8. A Balanced Focus on New and Established Algorithms 8:50

7M ago8:50

8:50

Spoken (by a human) version of this article. Even in discussions among AI governance professionals, there seems to be a silent “gen” before AI. With rapid progress - or rather prominence – of generative AI capabilities, these have taken centre stage. Amidst this excitement, we mustn't lose sight of the established algorithms and data-enabled workfl…

1
Article 7. Postcodes: Hidden Proxies for Protected Attributes 11:31

7M ago11:31

11:31

Spoken (by a human) version of this article. In a previous article, we discussed algorithmic fairness, and how seemingly neutral data points can become proxies for protected attributes. In this article, we'll explore a concrete example of a proxy used in insurance and banking algorithms: postcodes. We've used Australian terminology and data. But th…

1
Article 6. Balancing Security and Access for increased algorithmic integrity 5:41

8M ago5:41

5:41

Spoken (by a human) version of this article. When we talk about security in algorithmic systems, it's easy to focus solely on keeping the bad guys out. But there's another side to this coin that's just as important: making sure the right people can get in. This article aims to explain how security and access work together for better algorithm integ…

1
Article 5. Equal vs Equitable: Algorithmic Fairness 13:53

8M ago13:53

13:53

Spoken (by a human) version of this article. Fairness in algorithmic systems is a multi-faceted, and developing, topic. In episode 4, we explored ten key aspects to consider when scoping an algorithm integrity audit. One aspect was fairness, with this in the description: "...The design ensures equitable treatment..." This raises an important questi…

1
Article 4. Structuring the Audit Objective: 10 Key Aspects of Algorithm Integrity 12:56

8M ago12:56

12:56

Spoken (by a human) version of this article. In Episode 1, we explored the challenges of placing undue reliance on audits. One potential solution that we outlined is a clear scope, particularly regarding the audit objective. In this episode, we focus on algorithm integrity as the broad audit objective. While it’s easy to assert that an algorithm ha…

1
Article 3. Navigate Algorithm Audit Guidance: some aren't relevant to your context 8:55

8M ago8:55

8:55

Spoken (by a human) version of this article. AI and algorithm audits help ensure ethical and accurate data processing, preventing harm and disadvantage. However, the guidelines are not yet mature, and quite disparate. This can make the audit process confusing, and quite daunting - how do you wade through it all to find the information that you need…

1
58. The final episode 44:11

8M ago44:11

44:11

This is the final episode of this podcast. It includes: an explanation - why the podcast is coming to a close. snippets from a selection of prior episodes a brief introduction to Algorithm Integrity Matters - the new Risk Insights podcast. About this podcast The podcast for performance auditors and internal auditors that use (or want to use) data. …

1
Article 2. Choice vs obligation: motivation shapes the effectiveness of your review 6:53

9M ago6:53

6:53

Spoken (by a human) version of this article. The motivation(s) for commissioning a review can determine how effective it will be. Consider a personal health check-up: Sometimes we undergo medical check-ups because we don’t have a choice. We need to - for example for workplace requirements or for insurance. At other times, we choose to undergo such …

1
Article 1. How reliable is the algorithm review that you have commissioned? 10:14

9M ago10:14

10:14

Spoken (by a human) version of this article. One common issue with audits is undue reliance. Can you rely on the audit report to tell you what you need to know? Could you be relying on it too much? https://riskinsights.com.au/blog/reliable-audits About this podcast A podcast for Financial Services leaders, where we discuss fairness and accuracy in …

1
0. Introduction 1:41

9M ago1:41

1:41

A brief intro to the podcast. If you have suggestions for topics you'd like me to cover, feel free to reach out to me via email. [email protected] About this podcast A podcast for Financial Services leaders, where we discuss fairness and accuracy in the use of data, algorithms, and AI. Hosted by Yusuf Moolla. Produced by Risk Insights (risk…

1
57. Michael Drechnowicz, Head of Internal Audit, TK Elevator 35:06

1+ y ago35:06

35:06

Embracing Internal Audit Evolution: A Conversation with Michael Drechnowicz, Head of Internal Audit at TK Elevator In this episode, Michael shares his insights on the evolution of IA in his role as Head of Internal Audit with a major player in the global elevator and escalator industry. His work demonstrates a shift from traditional finance-focus t…

1
25 | NYC Deputy Comptroller for Audit - Maura Hayes-Chaffe 35:01

2y ago35:01

35:01

Maura Hayes-Chaffe is the Deputy Comptroller for Audit in New York City. Maura joined us to discuss the Bureau of Audit, including: the challenges with recruiting and attracting performance auditors new approaches to conducting PAs the changing environment (e.g., economics) equity in PA, citizen powered audits, and a recent housing related audit th…

1
56. Cathy O'Neil, Algorithm Auditor, Author of WMathD 44:06

2y ago44:06

44:06

Our guest is Cathy O'Neil, author of Weapons of Math Destruction: how big data increases inequality and threatens democracy. Cathy joined us to discuss critical aspects for auditors to consider, including: The human element: why understanding 'for whom an algorithm might fail' is more important than the detailed technical design of an algorithm. Al…

1
24 | Cathy O'Neil, Algorithm Auditor, Author of WMathD 44:22

2y ago44:22

44:22

Our guest is Cathy O'Neil, author of Weapons of Math Destruction: how big data increases inequality and threatens democracy. Cathy joined us to discuss critical aspects for auditors to consider, including: The human element: why understanding 'for whom an algorithm might fail' is more important than the detailed technical design of an algorithm. Al…

1
23 | North Dakota Audit Office and a vaccine PA 30:10

2y ago30:10

30:10

This episode featured guests from the North Dakota State Audit Office: Allison Bader, Performance Audit Manager and Claudia Kuball, Performance Auditor. In this episode we discuss: Team diversity – the value of recruiting performance auditors from different backgrounds, incl. how specialist expertise can help focus on major risks Impact – their com…

1
22 | Engaging citizens in performance auditing 11:22

2+ y ago11:22

11:22

In this episode, we discuss how audit offices are engaging citizens in performance audits. The show notes here and the full article here contain further details and examples. We delve into how audit offices are engaging citizens: Forward work plans – consulting broadly for focus areas Refining the broad focus areas for specific citizen concerns Aud…

1
21 | Planning with data 18:10

2+ y ago18:10

18:10

This originally aired as episode 50 of The Assurance Show. In this episode, we discuss the benefits of adopting a data focused approach during audit planning. Link: This episode's web page - https://pareports.com/podcast/21 About this podcast The podcast for performance auditors. Hosted by Conor McGarrity and Yusuf Moolla. Produced by PA Reports - …

1
20 | Work plan balance 16:22

2+ y ago16:22

16:22

This originally aired as episode 49 of The Assurance Show. In this episode, we discuss the importance of balance in your work program - covering each of the four objectives: Effectiveness Efficiency Economy Compliance Link: This episode's web page - https://pareports.com/podcast/20 About this podcast The podcast for performance auditors. Hosted by …

1
19 | Forward Work Planning 16:33

2+ y ago16:33

16:33

This originally aired as episode 48 of The Assurance Show. In this episode, we discuss strategic audit planning (a.k.a. forward work planning). Understanding your community / public expectations Understanding your elected body / parliamentarians Understanding the entities within your audit office's jurisdiction Link: This episode's web page - https…

1
18 | Michael Pickup, Auditor-General of British Columbia (Canada) 44:44

2+ y ago44:44

44:44

Michael Pickup is the Auditor General of British Columbia in Canada. In this episode we discuss: the changing role of performance audit recruitment and retention workplace flexibility people and product focused innovation the use of video and other media to increase reach Links: Michael Pickup on LinkedIn - https://www.linkedin.com/in/michael-picku…

1
17 | Four QA Steps - data in audit 10:47

2+ y ago10:47

10:47

This originally aired as episode 39 of The Assurance Show. In using data for audits, quality assurance of our work is important. In this episode, we discuss: 1. The four main QA steps Technical QA Functional QA Business QA (validation) Audit QA 2. Why we need a QA Plan Link: This episode's web page - https://pareports.com/podcast/17 About this podc…

1
16 | Open Data 19:42

2+ y ago19:42

19:42

This is an edited version of episode 13 of The Assurance Show. In this episode we discuss the use of Open Data. Links The Open Data Handbook - https://opendatahandbook.org/ Google dataset search - https://datasetsearch.research.google.com/ This episode's web page - https://pareports.com/podcast/16 About this podcast The podcast for performance audi…

1
15 | Patrick Barr, PA Director at the Northern Ireland Audit Office 34:58

2+ y ago34:58

34:58

Patrick Barr is Director, Performance Audit at the Northern Ireland Audit Office. In this episode we discuss: Recruitment challenges and staff attraction strategies The audit office's approach to topic selection and responsive auditing Upskilling performance auditors in the use of data Recent significant reports and their impact Outreach to other o…

1
14 | Data visualization with Alli Torban 35:36

2+ y ago35:36

35:36

This originally aired as Episode 32 of The Assurance Show. Alli is an information design consultant and host of the Data Viz Today podcast. We talk about a range of data visualization matters, including 3 key mistakes that people make when starting out in dataviz (and solutions to those). You can reach out to Alli via her website - https://www.alli…

1
13 | Monitoring the status of performance audit recommendations (including follow-up audits) 11:25

2+ y ago11:25

11:25

In this episode, we talk about how audit offices monitor (and report on) the status of implementation of performance audit recommendations. We monitor the status of our PA recommendations for several reasons: We want to ensure that our work has impact We may have a legislative requirement to follow-up Stakeholders have asked us to provide updates o…

1
12 | Using data in performance audit with Gemma Diamond and Morag Campsie, Audit Scotland 36:16

2+ y ago36:16

36:16

This originally aired as Episode 37 of The Assurance Show. Morag (Senior Manager) and Gemma (Director) are Performance Auditors with Audit Scotland. In this episode we discuss how they are using data in their audits, their experience in developing Audit Scotland's data capabilities, collaboration with other audit offices and what the future roadmap…

1
11 | Kelsey Thompson, performance auditor and podcast host 27:49

2+ y ago27:49

27:49

Kelsey Thompson is an Assistant City Auditor with the Office of the City Auditor in Austin, Texas. In this episode we discuss: What Kelsey enjoys about performance audit in local government The role of the Office of the City Auditor Why performance auditors need a data ‘mindset’ Topical reports on issues such as climate change, homelessness and pol…

1
10 | John Moore, CTO of Queensland Audit Office 19:34

2+ y ago19:34

19:34

This originally aired as Episode 30 of The Assurance Show. John talks to us about the role of the CTO in an audit office. He shares his views on a range of issues including: How he supports the audit office Cyber and data governance frameworks Evolving IT practices that auditors need to keep a close eye on Links John Moore on LinkedIn (www.linkedin…

1
9 | Alternate types of Performance Audit reporting/assurance 20:50

2+ y ago20:50

20:50

Performance audits are usually conducted as reasonable assurance engagements. Many audit offices also provide other types of assurance or other forms of reporting. These are often produced by performance audit functions, or are closely related to PA. Sometimes these alternate forms of delivery can be faster and cheaper, without diminishing the inte…

1
8 | Stephen McAteer, Performance Audit Data Scientist at VAGO 33:18

2+ y ago33:18

33:18

This originally aired as Episode 35 of The Assurance Show. Stephen McAteer leads the data science team within Performance Audit at VAGO, the Victorian Auditor General's Office. In this episode, we discuss: What VAGO does Stephen's approach to helping auditors use data Why it's important for all performance auditors to have data skills How VAGO has …

1
7 | Mike Scott, Performance Auditor and ACAG member 33:30

2+ y ago33:30

33:30

Mike Scott is Lead Auditor and Manager Assurance and Audit at the New Zealand Department of Internal Affairs. He has over 30 years of audit experience, including 15 years in performance audit with the New Zealand Office of the Auditor-General and 17 years with the UK National Audit Office. In this episode, we discuss: How the discipline of performa…

1
6 | Taka Ariga, GAO Chief Data Scientist and Director of Innovation Lab 36:09

2+ y ago36:09

36:09

This originally aired as Episode 34 of The Assurance Show. Taka Ariga is the inaugural Chief Data Scientist at the US Government Accountability Office. He also leads the GAO's Innovation Lab. In this episode, we discussed: What the GAO does How data science is helping GAO Innovation and experimentation at GAO Machine learning assurance You can reac…

Podcasts Worth a Listen

Yusuf Moolla Podcasts

Podcasts Worth a Listen

Quick Reference Guide