Best Risk Insights Yusuf Moolla Podcasts (2025)

1
Article 23. Algorithmic System Integrity: Testing 5:47

2M ago5:47

5:47

Spoken by a human version of this article. TL;DR (TL;DL?) Testing is a core basic step for algorithmic integrity. Testing involves various stages, from developer self-checks to UAT. Where these happen will depend on whether the system is built in-house or bought. Testing needs to cover several integrity aspects, including accuracy, fairness, securi…

1
Article 22. Algorithm Integrity: Third party assurance 7:26

2M ago7:26

7:26

Spoken by a human version of this article. One question that comes up often is “How do we obtain assurance about third party products or services?” Depending on the nature of the relationship, and what you need assurance for, this can vary widely. This article attempts to lay out the options, considerations, and key steps to take. TL;DR (TL;DL?) Th…

1
Guest 3. Shea Brown, Founder and CEO of BABL AI 41:23

3M ago41:23

41:23

Navigating AI Audits with Dr. Shea Brown Dr. Shea Brown is Founder and CEO of BABL AI BABL specializes in auditing and certifying AI systems, consulting on responsible AI practices, and offering online education. Shea shares his journey from astrophysics to AI auditing, the core services provided by BABL AI including compliance audits, technical te…

1
Article 21. AI Risk Training: Role-based tailoring 6:26

3M ago6:26

6:26

Spoken by a human version of this article. AI literacy is growing in importance (e.g., EU AI Act, IAIS). AI literacy needs vary across roles. Even "AI professionals" need AI Risk training. Links EU AI Act: The European Union Artificial Intelligence Act - specific expectation about “AI literacy”. IAIS: The International Association of Insurance Supe…

1
Guest 2. Patrick Sullivan: VP of Strategy and Innovation at A-LIGN 32:03

3M ago32:03

32:03

Navigating AI Governance and Compliance Patrick Sullivan is Vice President of Strategy and Innovation at A-LIGN and an expert in cybersecurity and AI compliance with over 25 years of experience. Patrick shares his career journey, discusses his passion for educating executives and directors on effective governance, and explains the critical role of …

1
Guest 1. Ryan Carrier: Executive Director of ForHumanity 44:49

3M ago44:49

44:49

Mitigating AI Risks Ryan Carrier is founder and executive director of ForHumanity, a non-profit focused on mitigating the risks associated with AI, autonomous, and algorithmic systems. With 25 years of experience in financial services, Ryan discusses ForHumanity's mission to analyze and mitigate the downside risks of AI to benefit society. The conv…

1
Article 20. Algorithm Reviews: Public vs Private Reports 8:26

4M ago8:26

8:26

Spoken (by a human) version of this article. Public AI audit reports aren't universally required; they mainly apply to high-risk applications and/or specific jurisdictions. The push for transparency primarily concerns independent audits, not internal reviews. Prepare by implementing ethical AI practices and conducting regular reviews. Note: High-ri…

1
Article 19. Algorithmic System Reviews: Substantive vs. Controls Testing 6:26

4M ago6:26

6:26

Spoken by a human version of this article. Knowing the basics of substantive testing vs. controls testing can help you determine if the review will meet your needs. Substantive testing directly identifies errors or unfairness, while controls testing evaluates governance effectiveness. The results/conclusions are different. Understanding these diffe…

1
Article 18. Algorithm Integrity: Training and Awareness 4:07

5M ago4:07

4:07

Spoken by a human version of this article. Ongoing education helps everyone understand their role in responsibly developing and using algorithmic systems. Regulators and standard-setting bodies emphasise the need for AI literacy across all organisational levels. Links ForHumanity - join the growing community here. ForHumanity - free courses here. I…

1
Article 17. Algorithm Integrity: Audit vs Review 9:10

5M ago9:10

9:10

Spoken by a human version of this article. The terminology – “audit” vs “review” - is important, but clarity about deliverables is more important when commissioning algorithm integrity assessments. Audits are formal, with an opinion or conclusion that can often be shared externally. Reviews come in various forms and typically produce recommendation…

1
Article 16. Algorithmic System Accuracy Reviews – Choosing the Right Approach 8:07

5M ago8:07

8:07

Spoken (by a human) version of this article. Outcome-focused accuracy reviews directly verify results, offering more robust assurance than process-focused methods. This approach can catch translation errors, unintended consequences, and edge cases that process reviews might miss. While more time-consuming and complex, outcome-focused reviews provid…

1
Article 15. Algorithm Integrity Documentation - Getting Started 5:19

5M ago5:19

5:19

Spoken (by a human) version of this article. Documentation makes it easier to consistently maintain algorithm integrity. This is well known. But there are lots of types of documents to prepare, and often the first hurdle is just thinking about where to start. So this simple guide is meant to help do exactly that – get going. About this podcast A po…

1
Article 14. External data - use with care 6:59

6M ago6:59

6:59

Spoken (by a human) version of this article. Banks and insurers are increasingly using external data; using them beyond their intended purpose can be risky (e.g. discriminatory). Emerging regulations and regulatory guidance emphasise the need for active oversight by boards, senior management to ensure responsible use of external data. Keeping the c…

1
Article 13. Bridging the purpose-risk gap: Customer-first algorithmic risk assessments 7:18

6M ago7:18

7:18

Spoken (by a human) version of this article. Banks and insurers sometimes lose sight of their customer-centric purpose when assessing AI/algorithm risks, focusing instead on regular business risks and regulatory concerns. Regulators are noticing this disconnect. This article aims to outline why the disconnect happens and how we can fix it. Report m…

1
Article 12. Risk-Focused Principles for Change Control in Algorithmic Systems 12:00

6M ago12:00

12:00

Spoken (by a human) version of this article. With algorithmic systems, an change can trigger a cascade of unintended consequences, potentially compromising fairness, accountability, and public trust. So, managing changes is important. But if you use the wrong framework, your change control process may tick the boxes, but be both ineffective and ine…

1
Article 11. Deprovisioning User Access to Maintain Algorithm Integrity 9:27

6M ago9:27

9:27

Spoken (by a human) version of this article. The integrity of algorithmic systems goes beyond accuracy and fairness. In Episode 4, we outlined 10 key aspects of algorithm integrity. Number 5 in that list (not in order of importance) is Security: the algorithmic system needs to be protected from unauthorised access, manipulation and exploitation. In…

1
Article 10. Fairness reviews: identifying essential attributes 6:54

7M ago6:54

6:54

Spoken (by a human) version of this article. When we're checking for fairness in our algorithmic systems (incl. processes, models, rules), we often ask: What are the personal characteristics or attributes that, if used, could lead to discrimination? This article provides a basic framework for identifying and categorising these attributes. About thi…

1
Article 9. Algorithmic Integrity: Don't wait for legislation 10:39

7M ago10:39

10:39

Spoken (by a human) version of this article. Legislation isn't the silver bullet for algorithmic integrity. Are they useful? Sure. They help provide clarity and can reduce ambiguity. And once a law is passed, we must comply. However: existing legislation may already apply new algorithm-focused laws can be too narrow or quickly outdated standards ca…

1
Article 8. A Balanced Focus on New and Established Algorithms 8:50

7M ago8:50

8:50

Spoken (by a human) version of this article. Even in discussions among AI governance professionals, there seems to be a silent “gen” before AI. With rapid progress - or rather prominence – of generative AI capabilities, these have taken centre stage. Amidst this excitement, we mustn't lose sight of the established algorithms and data-enabled workfl…

1
Article 7. Postcodes: Hidden Proxies for Protected Attributes 11:31

7M ago11:31

11:31

Spoken (by a human) version of this article. In a previous article, we discussed algorithmic fairness, and how seemingly neutral data points can become proxies for protected attributes. In this article, we'll explore a concrete example of a proxy used in insurance and banking algorithms: postcodes. We've used Australian terminology and data. But th…

1
Article 6. Balancing Security and Access for increased algorithmic integrity 5:41

8M ago5:41

5:41

Spoken (by a human) version of this article. When we talk about security in algorithmic systems, it's easy to focus solely on keeping the bad guys out. But there's another side to this coin that's just as important: making sure the right people can get in. This article aims to explain how security and access work together for better algorithm integ…

1
Article 5. Equal vs Equitable: Algorithmic Fairness 13:53

8M ago13:53

13:53

Spoken (by a human) version of this article. Fairness in algorithmic systems is a multi-faceted, and developing, topic. In episode 4, we explored ten key aspects to consider when scoping an algorithm integrity audit. One aspect was fairness, with this in the description: "...The design ensures equitable treatment..." This raises an important questi…

1
Article 4. Structuring the Audit Objective: 10 Key Aspects of Algorithm Integrity 12:56

8M ago12:56

12:56

Spoken (by a human) version of this article. In Episode 1, we explored the challenges of placing undue reliance on audits. One potential solution that we outlined is a clear scope, particularly regarding the audit objective. In this episode, we focus on algorithm integrity as the broad audit objective. While it’s easy to assert that an algorithm ha…

1
Article 3. Navigate Algorithm Audit Guidance: some aren't relevant to your context 8:55

8M ago8:55

8:55

Spoken (by a human) version of this article. AI and algorithm audits help ensure ethical and accurate data processing, preventing harm and disadvantage. However, the guidelines are not yet mature, and quite disparate. This can make the audit process confusing, and quite daunting - how do you wade through it all to find the information that you need…

1
58. The final episode 44:11

8M ago44:11

44:11

This is the final episode of this podcast. It includes: an explanation - why the podcast is coming to a close. snippets from a selection of prior episodes a brief introduction to Algorithm Integrity Matters - the new Risk Insights podcast. About this podcast The podcast for performance auditors and internal auditors that use (or want to use) data. …

1
Article 2. Choice vs obligation: motivation shapes the effectiveness of your review 6:53

8M ago6:53

6:53

Spoken (by a human) version of this article. The motivation(s) for commissioning a review can determine how effective it will be. Consider a personal health check-up: Sometimes we undergo medical check-ups because we don’t have a choice. We need to - for example for workplace requirements or for insurance. At other times, we choose to undergo such …

1
Article 1. How reliable is the algorithm review that you have commissioned? 10:14

9M ago10:14

10:14

Spoken (by a human) version of this article. One common issue with audits is undue reliance. Can you rely on the audit report to tell you what you need to know? Could you be relying on it too much? https://riskinsights.com.au/blog/reliable-audits About this podcast A podcast for Financial Services leaders, where we discuss fairness and accuracy in …

1
0. Introduction 1:41

9M ago1:41

1:41

A brief intro to the podcast. If you have suggestions for topics you'd like me to cover, feel free to reach out to me via email. [email protected] About this podcast A podcast for Financial Services leaders, where we discuss fairness and accuracy in the use of data, algorithms, and AI. Hosted by Yusuf Moolla. Produced by Risk Insights (risk…

1
57. Michael Drechnowicz, Head of Internal Audit, TK Elevator 35:06

1+ y ago35:06

35:06

Embracing Internal Audit Evolution: A Conversation with Michael Drechnowicz, Head of Internal Audit at TK Elevator In this episode, Michael shares his insights on the evolution of IA in his role as Head of Internal Audit with a major player in the global elevator and escalator industry. His work demonstrates a shift from traditional finance-focus t…

1
56. Cathy O'Neil, Algorithm Auditor, Author of WMathD 44:06

2y ago44:06

44:06

Our guest is Cathy O'Neil, author of Weapons of Math Destruction: how big data increases inequality and threatens democracy. Cathy joined us to discuss critical aspects for auditors to consider, including: The human element: why understanding 'for whom an algorithm might fail' is more important than the detailed technical design of an algorithm. Al…

1
55. Data Science and KNIME with Maarit Widmann 20:36

3y ago20:36

20:36

Maarit Widmann is a data scientist at KNIME (www.knime.com) In this episode, we discuss: What KNIME is Why the visual programming paradigm (workflows, rather than code) is appealing to both technical and non-technical professionals The most challenging aspects of the data science lifecycle, and what auditors should be aware of The most important as…

1
54. Analysis 19:17

3+ y ago19:17

19:17

In this episode we discuss the use of the word "analysis" in the context of using data for audits. This is an attempt to define the "analysis phase" - or stop using it as the name of a phase - so that we can better structure our work. This is explored in more depth in our book, here: https://riskinsights.com.au/the-data-confident-internal-auditor A…

1
53. The Data-Confident Internal Auditor 23:49

3+ y ago23:49

23:49

This episode is a pre-recorded interview with Benji Block for the Author Hour podcast. We discuss our new book, The Data-Confident Internal Auditor. For internal auditors, developing trends in data analysis and data science can feel less like a wealth of information and more like an avalanche. Still, better use of data provides an opportunity to ad…

1
52. Simplicity 16:28

3+ y ago16:28

16:28

In this episode we discuss why and how audit quality is improved when we keep things simple. About this podcast The podcast for performance auditors and internal auditors that use (or want to use) data. Hosted by Conor McGarrity and Yusuf Moolla. Produced by Risk Insights (riskinsights.com.au).

1
51. Performance Audit Mini-Series #4: Conduct/Fieldwork 13:34

3+ y ago13:34

13:34

This is the fourth in a series of episodes that focus on performance auditing. In this episode, we discuss five suggestions to help improve the conduct (fieldwork / execution) phase. About this podcast The podcast for performance auditors and internal auditors that use (or want to use) data. Hosted by Conor McGarrity and Yusuf Moolla. Produced by R…

1
50. Performance Audit Mini-Series #3 Planning with data 17:58

3+ y ago17:58

17:58

This is the third in a series of episodes that focus on performance auditing. In this episode, we discuss the benefits of adopting a data focused approach during audit planning. About this podcast The podcast for performance auditors and internal auditors that use (or want to use) data. Hosted by Conor McGarrity and Yusuf Moolla. Produced by Risk I…

1
49. Performance Audit Mini-Series #2 Work Program Balance 15:55

3+ y ago15:55

15:55

This is the second of a series of episodes that focus on performance auditing. In this episode, we discuss the importance of balance in your work program - covering each of the four objectives: Effectiveness Efficiency Economy Compliance About this podcast The podcast for performance auditors and internal auditors that use (or want to use) data. Ho…

1
48. Performance Audit Mini-Series #1 Forward Work Planning 17:59

3+ y ago17:59

17:59

This is the first of a series of episodes that focus on performance auditing. In this episode, we discuss strategic audit planning (a.k.a. forward work planning). For internal auditors, this is similar to annual (or equivalent) audit planning. Understanding your community / public expectations Understanding your elected body / parliamentarians Unde…

1
47. Three practical ways to fast-track the data cleansing process 9:41

3+ y ago9:41

9:41

In this episode we discuss three simple ways to improve the data cleansing process - easier, faster and higher quality. Find the optimal data source (e.g., don't use a poorly structured dataset) Cleanse iteratively - you may not need all of the fields/columns Import iteratively - start with a subset of the data and build on that as needed About thi…

1
46. Combining data to create risk indicators for audits and risk monitoring/exploration 14:52

4y ago14:52

14:52

In this episode we discuss the use of risk/performance indicators. These can be used by audit teams, risk teams and integrity agencies. For audit teams, they are useful throughout the audit lifecycle - planning / risk assessment, fieldwork / conduct and reporting. We explore why they are useful, what to do and briefly how to get started. About this…

1
45. How ANAO uses data in performance audits - with Xiaoyan Lu and Christine Chalmers 19:34

4y ago19:34

19:34

Christine (performance audit) and Xiaoyan (data analytics) are Directors with ANAO, the Australian National Audit Office. In this episode we discuss: What The Australian National Audit Office (www.anao.gov.au) does The five ways ANAO uses data in its performance audits How performance audit teams work with the central data team Challenges with data…

1
44. ESG and Sustainable Investing with Tiina Landau 28:36

4y ago28:36

28:36

Tiina Landau is an internationally recognized sustainability expert and Certified European Financial Analyst (CEFA). She currently works as Sustainability Manager at Neste Corporation, embedding sustainability considerations into new business models and supply chains. She has extensive experience as a speaker in media and seminars and also writes a…

1
43. Microsoft 365 Compliance with Erica Toelle 24:59

4y ago24:59

24:59

Erica Toelle is a senior product marketing manager on the Microsoft compliance product team, with focus on information governance and records management. Erica is a long-time member of the SharePoint and Microsoft 365 community, a former Microsoft MVP, a published author, and a recognized expert in the information governance area. In this episode, …

1
42. Michael DeCero, a Data Professional at TDS with an Internal Audit background 25:58

4y ago25:58

25:58

Michael DeCero is an Internal Audit Analytics Manager at TDS, a telecommunications company. In this episode, Michael explains how he helps his audit team use data. Links: Towards Data Science (www.linkedin.com/company/towards-data-science) Michael on LinkedIn (www.linkedin.com/in/michael-decero-39b95b44/) About this podcast The podcast for performa…

1
41. Steve Rummel, Senior IA Analytics Manager at CVS Health 34:35

4y ago34:35

34:35

Steve Rummel is a Senior Internal Audit Analytics Manager at CVS Health. In this episode, Steve explains how he helps his audit team use data. About this podcast The podcast for performance auditors and internal auditors that use (or want to use) data. Hosted by Conor McGarrity and Yusuf Moolla. Produced by Risk Insights (riskinsights.com.au).…

1
40. A CIO/CRO perspective on risk, security and internal audit with Ari Levien 25:54

4y ago25:54

25:54

Ari Levien is an experienced Chief Information Officer who has also played the role of Chief Risk Officer. In this episode we discuss how a CIO (with an understanding of risk) thinks about security and risk. We also discuss his views of Internal Audit and what good looks like for IA. About this podcast The podcast for performance auditors and inter…

1
39. Four Quality Assurance Steps - Data in Audit 10:35

4y ago10:35

10:35

In using data for audits, quality assurance of our work is important. In this episode, we discuss: 1. The four main QA steps Technical QA Functional QA Business QA (validation) Audit QA 2. Why we need a QA Plan This is explored in more depth in our book, here: https://riskinsights.com.au/the-data-confident-internal-auditor About this podcast The po…

1
38. Why We Should Spend Time Preparing Our Data and Checking Quality 13:00

4y ago13:00

13:00

In this episode, we discuss FIVE major benefits of investing our time in preparing our data and checking its quality. These include, in reverse order of importance: 1. Exploration during data prep to understand the data 2. Ensure the data is in the right format for analysis 3. Save time by avoiding incorrect conclusions 4. Confidence in the analysi…

1
37. Using data in performance audit with Gemma Diamond and Morag Campsie (Audit Scotland) 36:05

4y ago36:05

36:05

Morag (Senior Manager) and Gemma (Director) are Performance Auditors with Audit Scotland. In this episode we discuss how they are using data in their audits, their experience in developing Audit Scotland's data capabilities, collaboration with other audit offices and what the future roadmap looks like. We also discuss their focus on ensuring their …

1
36. Why the audit objective should drive our use of data 20:21

4y ago20:21

20:21

In this episode, we discuss why it is important to focus on our audit objective when using data analysis in our audit. We explore: Why a focus on the objective helps us measure success Why we should avoid rules based analysis How a focus on the objective helps us stay true to our audit mandate Cost benefit analysis when we find things that are not …

Podcasts Worth a Listen

Risk Insights Yusuf Moolla Podcasts

Podcasts Worth a Listen

Quick Reference Guide