Artwork

Content provided by Team PolyAI. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Team PolyAI or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.
Player FM - Podcast App
Go offline with the Player FM app!
icon Daily Deals

047: The anatomy of a voice assistant, part 3 - Large language models (LLMs)

27:46
 
Share
 

Manage episode 438398417 series 3533896
Content provided by Team PolyAI. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Team PolyAI or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.

Send us a text

It's the third in a series of technical deep dives for building IVAs, and for this episode, it's all about LLMs. Kylie chats with Shawn Wen, co-founder and CTO at PolyAI, who explains why LLMs can accomplish 70% of what’s needed for voice assistants, and more importantly: what's involved in the remaining 30%. The discussion touches on strategies to manage challenges through prompt engineering, dialogue management, and integrating third-party APIs, while highlighting the similarities between AI and human behavior. A look into cybersecurity and the future of specialized LLMs rounds out the conversation, offering insights for industry professionals navigating this evolving technology.

Follow PolyAI on LinkedIn
Watch this and other episodes of the Deep Learning pod on YouTube

  continue reading

75 episodes

Artwork
iconShare
 
Manage episode 438398417 series 3533896
Content provided by Team PolyAI. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Team PolyAI or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.

Send us a text

It's the third in a series of technical deep dives for building IVAs, and for this episode, it's all about LLMs. Kylie chats with Shawn Wen, co-founder and CTO at PolyAI, who explains why LLMs can accomplish 70% of what’s needed for voice assistants, and more importantly: what's involved in the remaining 30%. The discussion touches on strategies to manage challenges through prompt engineering, dialogue management, and integrating third-party APIs, while highlighting the similarities between AI and human behavior. A look into cybersecurity and the future of specialized LLMs rounds out the conversation, offering insights for industry professionals navigating this evolving technology.

Follow PolyAI on LinkedIn
Watch this and other episodes of the Deep Learning pod on YouTube

  continue reading

75 episodes

All episodes

×
 
Send us a text Fortune article: http://fortune.com/2025/06/27/ai-rollup-investment-strategy/ Nikola reflects on his recent Fortune commentary (above) into the transformative potential of AI rollup strategies in Business Process Outsourcing (BPO). He and Damien discuss the concept of AI rollups (where private equity firms consolidate service companies to create more efficient, tech-enabled businesses), as well as the unique challenges and opportunities associated with integrating AI into existing BPOs, the role of Global Systems Integrators (GSIs), and the evolving landscape of customer service automation. Hear why the world won't be rewritten by AI overnight but will transform progressively" in this week's Deep Learning! Follow PolyAI on LinkedIn Watch this and other episodes of the Deep Learning pod on YouTube…
 
Send us a text Nikola and Damien are back to discuss the ongoing evolution of AI in the contact center industry. We'll explore whether AI is truly replacing human workers or simply augmenting their capabilities, covering Klarna's automation efforts and recent Gartner predictions, and analyzing the challenges and opportunities in implementing AI solutions. We touch on essential aspects of project management, customer service strategies, and the future of AI integration in contact centers. Join us, or be assimilated! Follow PolyAI on LinkedIn Watch this and other episodes of the Deep Learning pod on YouTube…
 
D
Deep Learning with PolyAI
Deep Learning with PolyAI podcast artwork
 
Send us a text VP of Product Marketing Brian Thompson joins Nikola to discuss the current state and future prospects of AI in financial services, including banking and insurance. The chat covers the importance of human oversight in AI deployments, the evolving landscape in banking and FinTech, optimization of back-office processes, and how financial institutions are leveraging generative AI. Brian shares insights on the differences between large legacy banks and smaller community banks, and the challenges and opportunities AI presents in bridging these gaps, while tackling customer expectations, regulatory concerns, and the significance of a strategic approach to AI implementation. Follow PolyAI on LinkedIn Watch this and other episodes of the Deep Learning pod on YouTube…
 
Send us a text Damien and Nikola are back to discuss the transformative impact of generative AI in our everyday lives. The conversation covers everything from the rise of LLMs in personal development and therapy to DIY projects and coding. Discover how generative AI is reshaping industries, solving everyday problems, and why it's gaining traction in fields like legal services and medical advice. as well as future applications of AI. Follow PolyAI on LinkedIn Watch this and other episodes of the Deep Learning pod on YouTube…
 
Send us a text Guest host Meghan Berton and VP of Engineering Razvan Kusztos cover the release of PolyAI's Owl ASR model, while dishing goss on the intricacies of developing high-performing speech recognition models. They discuss the significance of in-house SLU tech, the challenges of ensuring accuracy across different accents and environments, and the benefits of using synthetic data. The conversation also covers the cultural nuances in text to speech models and how Poly AI leverages partnerships with companies like NVIDIA for enhanced model performance. Follow PolyAI on LinkedIn Watch this and other episodes of the Deep Learning pod on YouTube…
 
D
Deep Learning with PolyAI
Deep Learning with PolyAI podcast artwork
 
Send us a text Damien and Nikola discuss the brave initiatives taken by executives in the field of generative AI, their successes, and challenges. Nikola Mrkšić, CEO and co-founder of PolyAI, shares insights on differentiation in the generative AI space, the viability of build vs. buy decisions, and the importance of proof of concept in AI projects. The episode sheds light on the technological advancements and strategic decisions that help organizations capitalize on generative AI, with illustrative case studies and industry comparisons. Follow PolyAI on LinkedIn Watch this and other episodes of the Deep Learning pod on YouTube…
 
Send us a text Damien and Nikola discuss the implications of AI-first approaches in industries, with a focus on how companies like Duolingo and Klarna are navigating the AI transformation. We explore the concept of an intelligent enterprise operating system and debate whether traditional companies can adapt quickly enough. Additionally, we examine the potential impacts on human employment and strategies for businesses to keep their employees motivated amidst these changes. Follow PolyAI on LinkedIn Watch this and other episodes of the Deep Learning pod on YouTube…
 
Send us a text In this buzzy episode, Damien hosts PolyAI's Senior Vice President of Product, Devidas Desai, to announce the launch of Agent Studio, the world's only voice-first omnichannel CX platform for AI agents. Devidas provides an in-depth look into what Agent Studio is and discusses how the platform has been rigorously tested with live enterprise deployments and includes proprietary technologies like advanced automatic speech recognition and specialized language models. Hear about flagship tech like 'Talk Tracks,' and more of its future enhancements. Follow PolyAI on LinkedIn Watch this and other episodes of the Deep Learning pod on YouTube…
 
Send us a text Damien and Nikola are back to discuss the impact of removing toll-free numbers for government services, focusing on the DOGE/Social Security Administration's briefly considered decision. They explore the potential operational and cost-saving implications of voice AI in government services, the challenges of optimizing such large systems, and the long-term strategies for digital transformation. The discussion also touches on the changing preferences of Generation Z towards voice communication and the importance of careful, well-planned implementation of automation in government operations. Follow PolyAI on LinkedIn Watch this and other episodes of the Deep Learning pod on YouTube…
 
Send us a text Nikola and Damien chew the fat about developments from AI giants Anthropic and OpenAI, comparing their new models: Claude 3.7 and GPT-4.5 Orion, and where they place in the consumer and enterprise markets. We also touch on OAI's specialized agents for hire, Amazon's new agentic AI division and the recent stance of the US Patent Office on AI-generated content. Follow PolyAI on LinkedIn Watch this and other episodes of the Deep Learning pod on YouTube…
 
Send us a text In the closing episode of Deep Learning's deep dive on telephony, Nikola and Oisin discuss innovative ideas in telephony, especially the concept of using a universal AI ringtone to replace lengthy warnings and terms during calls. They debate the efficacy of this idea and its potential global impact on user experience. They also touch on the challenges of integrating AI within legacy telephony systems and explore different modern communication protocols like Gibberlink. The conversation also highlights the inefficiencies of current hold systems and the untapped potential of AI in streamlining B2B interactions. Follow PolyAI on LinkedIn Watch this and other episodes of the Deep Learning pod on YouTube…
 
Send us a text The second episode of a three-part miniseries sees Deep Learning with PolyAI continue exploring the intricate world of telephony and VoIP! Nikola welcomes back Oisin Glenn, VP of Solutions Consulting, to chat about the historical development, current technologies, and the complexities of modern telephony. They discuss everything from PBX systems, VoIP protocols, and the rise of WebRTC to the unique challenges of international deployments, codec differences, and the open-source revolution in telephony. Learn how traditional telephony infrastructure is being replaced by scalable, IP-based systems and what the future holds for the industry. Whether you're an industry veteran or a curious newbie, this episode offers valuable insights into the telephony landscape. Follow PolyAI on LinkedIn Watch this and other episodes of the Deep Learning pod on YouTube…
 
D
Deep Learning with PolyAI
Deep Learning with PolyAI podcast artwork
 
Send us a text Nikola welcomes Oisin Glynn, VP of Solution Consulting, to discuss the fascinating history and evolution of modern telephony. Going back to the inception of telephone systems, from their early manual connections to the adoption of the PSTN and the advent of private branch exchanges (PBX), the conversation touches on the impact of the internet and mobile telephony on traditional phone systems, the rise of VoIP, and how companies like Cisco and Avaya played pivotal roles in transforming business communications. Whether you're curious about the historical milestones or the technical nuances of modern telecommunication, this episode is a perfect start to a series on the wizardry in present day telephonics. Follow PolyAI on LinkedIn Watch this and other episodes of the Deep Learning pod on YouTube…
 
Send us a text ** Check out the report that inspired the episode ** Damien welcomes PolyAI's senior director of brand, Kylie Whitehead, to discuss the findings from two comprehensive surveys highlighting trends in customer experience (CX) and contact center leadership. Learn about the evolving roles of CX leaders and the increasing influence of AI, as well as the differing sentiments of contact center agents towards automation. Follow PolyAI on LinkedIn Watch this and other episodes of the Deep Learning pod on YouTube…
 
Send us a text Bonus breaking news episode of the Deep Learning with PolyAI podcast! Hosts Damien and Nikola chat about the recent release of DeepSeek's open-source R1 model, which has sparked widespread reaction across the tech world. The R1 model, created with limited resources, has matched or exceeded benchmarks of leading models from OpenAI and Meta, prompting discussions on its potential impact on AI development and market dynamics. The episode explores DeepSeek's engineering feats, the subsequent market responses, and its implications for the future of open-source AI movements and global competition. Follow PolyAI on LinkedIn Watch this and other episodes of the Deep Learning pod on YouTube…
 
Loading …

Welcome to Player FM!

Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.

 

icon Daily Deals
icon Daily Deals
icon Daily Deals

Quick Reference Guide

Copyright 2025 | Privacy Policy | Terms of Service | | Copyright
Listen to this show while you explore
Play