#007 - Unlocking the Potential of AI in Embedded Systems with Daniel Situnayake

The Embedded Frontier

#Tech #Business #Podcasting Education #Jacob Beningo #Embedded Software #Embedded #Firmware #Technology Trends #Software Development #Edge Computing #Engineering #Developer Education #Embedded Technology #Real Time #Rtos

26:28

Squid Game is back—and this time, the knives are out. In the thrilling Season 3 premiere, Player 456 is spiraling and a brutal round of hide-and-seek forces players to kill or be killed. Hosts Phil Yu and Kiera Please break down Gi-hun’s descent into vengeance, Guard 011’s daring betrayal of the Game, and the shocking moment players are forced to choose between murdering their friends… or dying. Then, Carlos Juico and Gavin Ruta from the Jumpers Jump podcast join us to unpack their wild theories for the season. Plus, Phil and Kiera face off in a high-stakes round of “Hot Sweet Potato.” SPOILER ALERT! Make sure you watch Squid Game Season 3 Episode 1 before listening on. Play one last time. IG - @SquidGameNetflix X (f.k.a. Twitter) - @SquidGame Check out more from Phil Yu @angryasianman , Kiera Please @kieraplease and the Jumpers Jump podcast Listen to more from Netflix Podcasts . Squid Game: The Official Podcast is produced by Netflix and The Mash-Up Americans.…

about a year ago 47:45

MP3•Episode home

Summary
In this conversation, Jacob and Daniel Situnayake discuss the future of AI and machine learning in embedded software development. They explore the challenges and opportunities of implementing AI and machine learning at the edge, and how tools like TensorFlow Lite for Microcontrollers and Edge Impulse are making it easier for developers to deploy models on resource-constrained devices. They also discuss the importance of balancing model accuracy with resource constraints and the potential for AI-generated models in the future. Overall, the conversation highlights the growing interest and potential of AI and machine learning in the embedded space.

Keywords
AI, machine learning, embedded software development, TensorFlow Lite, Edge Impulse, resource constraints, model accuracy, AI-generated models

Takeaways

AI and machine learning are being increasingly applied to embedded software development, opening up new possibilities for edge devices.
Tools like TensorFlow Lite for Microcontrollers and Edge Impulse are making it easier for developers to implement AI and machine learning on resource-constrained devices.
Balancing model accuracy with resource constraints is a key consideration in embedded AI development.
The future of embedded AI and machine learning holds the potential for AI-generated models and more sophisticated applications at the edge.

Chapters

1. Introduction to Daniel Situnayake (00:00:00)

2. TensorFlow Lite for Microcontrollers and Edge Impulse (00:09:18)

3. Applications of Machine Learning at the Edge (00:17:03)

4. Balancing Model Accuracy and Resource Constraints (00:21:05)

5. The Future of Embedded AI and Machine Learning (00:32:41)

6. Recommendations and Conclusion (00:45:02)

17 episodes

#007 - Unlocking the Potential of AI in Embedded Systems with Daniel Situnayake

The Embedded Frontier

published about a year ago

MP3•Episode home

Keywords
AI, machine learning, embedded software development, TensorFlow Lite, Edge Impulse, resource constraints, model accuracy, AI-generated models

Takeaways

AI and machine learning are being increasingly applied to embedded software development, opening up new possibilities for edge devices.
Tools like TensorFlow Lite for Microcontrollers and Edge Impulse are making it easier for developers to implement AI and machine learning on resource-constrained devices.
Balancing model accuracy with resource constraints is a key consideration in embedded AI development.
The future of embedded AI and machine learning holds the potential for AI-generated models and more sophisticated applications at the edge.

Chapters

1. Introduction to Daniel Situnayake (00:00:00)

2. TensorFlow Lite for Microcontrollers and Edge Impulse (00:09:18)

3. Applications of Machine Learning at the Edge (00:17:03)

4. Balancing Model Accuracy and Resource Constraints (00:21:05)

5. The Future of Embedded AI and Machine Learning (00:32:41)

6. Recommendations and Conclusion (00:45:02)

17 episodes

All episodes

The Embedded Frontier

1
#016 - Modern Build Systems with Kyle Dando 40:23

5 weeks ago40:23

40:23

In this episode of the Embedded Frontier podcast, Jacob Beningo and Kyle Dando from NXP discuss the modernization of embedded software and firmware, focusing on the MCU Xpresso SDK. They explore the significant changes made to the SDK, including the adoption of CMake and KConfig, the introduction of West for managing software repositories, and the overall impact on developer workflows. The conversation also covers the migration path for existing users and future trends in embedded software development, emphasizing the importance of user feedback in shaping the SDK's evolution. Takeaways - Modern build systems are essential for embedded software development. - The MCU Xpresso SDK packages low-level drivers and middleware for ease of use. - Accessibility improvements were a primary focus in SDK modernization. - CMake was adopted for its universal build capabilities and customer demand. - West allows for efficient management of software from multiple repositories. - KConfig simplifies project configuration and dependency management. - Developers can choose between command line and IDE workflows. - Migration to the new SDK is designed to minimize disruption for users. - Future trends include support for new operating systems and ecosystems. - User feedback is vital for continuous improvement of the SDK.…

The Embedded Frontier

1
#015 - Modernizing Embedded Systems: Step #1 - Overhauling Your Build System 30:23

7 weeks ago30:23

30:23

In this episode of the Embedded Frontier Podcast, Jacob Beningo discusses the importance of modernizing build systems in embedded software development. He outlines a seven-step framework for developing faster and smarter firmware, focusing on the need to overhaul build systems to keep pace with contemporary development practices. The conversation covers containerization, the adoption of tools like CMake and West, and the integration of AI technologies to enhance build processes and ensure flexibility and scalability in software development. Takeaways - Overhauling your build system is crucial for modern development. - Build systems must adapt to contemporary software practices. - Containerization provides a consistent build environment. - CMake offers flexibility and modularity in builds. - West helps manage multiple repositories effectively. - Modern build systems should integrate with CI/CD workflows. - Flexibility in workflows enhances developer productivity. - AI can assist in transitioning to modern build systems. - Scalability is essential for long-term software projects. - A modern build system reduces stress and increases efficiency. Keywords embedded systems, build system, DevOps, CMake, containerization, software development, AI, firmware, modern architecture, CI/CD…

The Embedded Frontier

1
#014 - Modernizing Embedded Systems: A 7-Step Framework 38:02

9 weeks ago38:02

38:02

Summary In this episode of the Embedded Frontier Podcast, Jacob Beningo introduces a comprehensive framework for modernizing embedded systems development. He discusses the importance of adapting to modern techniques in firmware development, emphasizing the need for a shift in workflows, architectures, and tools. The episode outlines a seven-step process that includes modernizing build systems, improving software architecture, implementing DevOps practices, embracing test-driven development, leveraging simulation, adopting AI and machine learning, and establishing a metrics scoreboard to track progress. Each step is designed to help teams develop faster and smarter firmware, ultimately leading to more efficient and effective embedded systems development. Takeaways Modernizing firmware is essential for efficient development. The seven-step modernization framework includes build systems, architecture, DevOps, testing, simulation, AI, and metrics. Modern build systems should support various developer tools and environments. Software architecture must be scalable and flexible, separating application code from hardware. DevOps is crucial for improving collaboration and speeding up development cycles. Testing should be prioritized, with an emphasis on test-driven development (TDD). Simulation can help developers test application code without hardware dependencies. AI and machine learning can enhance both on-chip processing and development workflows. Metrics are essential for tracking progress and identifying areas for improvement. The framework aims to help teams deliver better products on time and within budget. Keywords embedded systems, firmware development, modernization framework, build systems, DevOps, test-driven development, simulation, AI, machine learning, metrics…

The Embedded Frontier

1
#013 - The Role of AI in Embedded Software Development 30:20

12 weeks ago30:20

30:20

In this episode of the Embedded Frontier podcast, Jacob Beningo explores the evolving role of artificial intelligence (AI) in embedded systems development. He discusses the potential applications of AI, including code review, documentation, and generating code, while emphasizing the importance of adopting AI technologies to enhance productivity and efficiency in the field. Beningo also addresses the challenges and risks associated with AI, advocating for its integration into development workflows to stay competitive in the industry. Takeaways AI has a unique role to play in embedded systems development. Documentation is a critical area where AI can assist developers. AI can help automate code reviews, making them more efficient. Using AI for generating code can speed up the prototyping process. AI can help document architectural decisions and trade-offs. The rapid evolution of AI technology presents both opportunities and risks. AI can serve as an augmentation tool for developers, enhancing their capabilities. Understanding how to effectively prompt AI is crucial for getting desired results. AI can help reduce technical debt by improving documentation practices. The integration of AI into workflows can lead to significant productivity gains.…

The Embedded Frontier

1
#012 - Trends from Embedded World 2025 39:32

15 weeks ago39:32

39:32

Summary In this episode of the Embedded Frontier, Jacob Beningo discusses the key trends observed at Embedded World 2025, focusing on the integration of commercial tools with modern workflows, the rise of Zephyr as a dominant RTOS, the pervasive influence of AI in embedded systems, the necessity of multi-core processors, and the mainstream adoption of DevOps practices. Beningo emphasizes the importance of adapting to these trends to enhance development efficiency and product reliability. Takeaways Commercial tools are starting to support open source development. Zephyr is becoming a dominant player in the embedded systems industry. AI technologies are increasingly being integrated into embedded devices. Multi-core processors are becoming essential for complex IoT applications. DevOps practices are being adopted more widely in embedded development. Security and compliance must be automated in development workflows. The integration of AI can significantly enhance embedded system capabilities. Open source and commercial tools can work together effectively. Modern workflows are essential for efficient embedded software development. The industry is evolving rapidly, and developers must adapt to stay competitive. Keywords embedded systems, trends, Zephyr, AI, multi-core processors, DevOps, modern workflows, commercial tools, open source, Embedded World 2025…

The Embedded Frontier

1
#011 - Mastering Embedded Systems: Lessons from 'The Embedded Project Cookbook' with John Taylor 32:52

21 weeks ago32:52

32:52

Summary In this conversation, Jacob Beningo interviews John Taylor about his extensive experience in embedded systems and his new book, 'The Embedded Project Cookbook.' They discuss the inspiration behind the book, its target audience, and key themes such as the importance of building and testing software before hardware. John shares insights on challenges in requirements gathering, the use of a reference design, and the transition from C to C++ in embedded projects. They also explore future trends in the industry, particularly the impact of AI, and conclude with key takeaways from the book. Takeaways John Taylor has over 30 years of experience in embedded systems. The Embedded Project Cookbook was inspired by the need for better documentation and processes. The primary audience for the book includes software architects and tech leads. Building and testing software before hardware can save time and improve code quality. Requirements gathering is a critical yet challenging aspect of embedded systems development. The GM 6000 digital heat controller serves as a relatable reference design in the book. Source code and frameworks provided in the book can help developers bootstrap their projects. C++ offers advantages in type safety and encapsulation for embedded systems. AI is becoming part of embedded workflows, but its understanding of embedded systems is still limited. Quality in projects requires planning and discipline beyond just writing code. Keywords Embedded Systems, Embedded Project Cookbook, Software Development, Requirements Gathering, C++, AI in Embedded Systems, Software Architecture, Project Management, Hardware Development, John Taylor…

The Embedded Frontier

1
#010 - Top Trends in Embedded Systems for 2025 36:38

26 weeks ago36:38

36:38

In this episode of Embedded Frontier, Jacob Beningo discusses the top trends in embedded systems for 2025. He highlights the increasing role of AI and machine learning, the dominance of open-source software, the critical importance of security, and the ongoing relevance of programming languages like C and C++. Beningo also emphasizes the rise of simulation technologies, the integration of DevOps and observability, and the expansion of edge AI, providing insights into how these trends will shape the future of embedded systems development. Takeaways · AI will enhance embedded systems development. · Machine learning applications are still underutilized. · Open-source software is becoming increasingly dominant. · Security is a top priority for embedded systems. · C remains the most widely used programming language. · Simulation technologies will modernize development processes. · DevOps practices are essential for improving software quality. · Edge AI will allow for local data processing. · Modern programming languages will see increased adoption. · 2025 will bring significant changes to embedded systems. Keywords embedded systems, AI, machine learning, open source, security, programming languages, DevOps, edge AI, simulation technologies…

The Embedded Frontier

1
#009 - Real-World Lessons in Embedded Security, AI, and Systems Development with Shawn Prestridge 41:19

40 weeks ago41:19

41:19

Curious about the future of embedded systems? In this episode, Jacob Beningo is joined by Shawn Prestridge from IAR Systems to tackle the pressing challenges developers face today. From real-world insights into AI’s role in embedded devices to the overlooked pitfalls of security in connected systems, Shawn shares practical lessons learned from his decades in the field. Whether you’re interested in how AI can transform your development process, or you're navigating the complexities of modern code quality and security, this conversation offers actionable strategies that every embedded developer needs. Don't miss this chance to learn from the cutting edge of embedded systems development.…

The Embedded Frontier

1
#008 - Are Embedded Manufacturers Ready for New IoT Security Compliance Demands with Francois Baldassari 42:10

45 weeks ago42:10

42:10

In this episode, Jacob Beningo interviews François Baldassari, Memfault CEO, about IoT security compliance demands. They discuss embedded manufacturers' readiness for new security regulations, the challenges they face, and potential solutions. They also explore the differences between the EU's Cyber Resilience Act and the US's Cyber Trust Mark. François emphasizes the importance of OTA updates, using open-source software, and building security teams within hardware companies. He also highlights the need for collecting the right data and observability to improve security posture. Takeaways Embedded manufacturers are not fully ready for new IoT security compliance demands. Regulatory frameworks like the EU's Cyber Resilience Act and the US's Cyber Trust Mark are coming into effect and will require certification of cybersecurity guidelines. Challenges include the uncertainty of the regulations, the additional costs and effort required, and the lack of established infrastructure and best practices. Recommendations for compliance include implementing OTA updates, using open-source software, adopting SBOM scanning, and ensuring observability of devices. AI is not currently a solution for compliance, but it may play a role in the future as more data is collected and analyzed. Joining the conversation around open-source products and following security best practices can help improve device security.…

The Embedded Frontier

1
#007 - Unlocking the Potential of AI in Embedded Systems with Daniel Situnayake 47:45

49 weeks ago47:45

47:45

Summary In this conversation, Jacob and Daniel Situnayake discuss the future of AI and machine learning in embedded software development. They explore the challenges and opportunities of implementing AI and machine learning at the edge, and how tools like TensorFlow Lite for Microcontrollers and Edge Impulse are making it easier for developers to deploy models on resource-constrained devices. They also discuss the importance of balancing model accuracy with resource constraints and the potential for AI-generated models in the future. Overall, the conversation highlights the growing interest and potential of AI and machine learning in the embedded space. Keywords AI, machine learning, embedded software development, TensorFlow Lite, Edge Impulse, resource constraints, model accuracy, AI-generated models Takeaways AI and machine learning are being increasingly applied to embedded software development, opening up new possibilities for edge devices. Tools like TensorFlow Lite for Microcontrollers and Edge Impulse are making it easier for developers to implement AI and machine learning on resource-constrained devices. Balancing model accuracy with resource constraints is a key consideration in embedded AI development. The future of embedded AI and machine learning holds the potential for AI-generated models and more sophisticated applications at the edge.…

The Embedded Frontier

1
#006 - Decreasing Debugging, Increasing Productivity 27:30

52 weeks ago27:30

27:30

In this episode, Jacob Beningo discusses the importance of debugging in embedded development and shares several techniques to decrease debugging time. He highlights the statistic that development teams spend 20-40% of their time debugging, which equates to 2.5-4.5 man-months of development. Beningo emphasizes the use of test-driven development (TDD) as a way to prevent bugs and decrease debugging time. He also recommends mastering debugging techniques for microcontrollers, using profiling and monitoring tools, employing assertions, and utilizing on-host simulation. Beningo concludes by encouraging listeners to track their debugging time and implement strategies to decrease it. Takeaways Development teams spend 20-40% of their time debugging, which can equate to 2.5-4.5 man months of development. Test-driven development (TDD) can help prevent bugs and decrease debugging time. Mastering debugging techniques for microcontrollers and utilizing profiling and monitoring tools can improve debugging efficiency. Using assertions and on-host simulation are additional techniques to decrease debugging time. Tracking debugging time and implementing strategies to decrease it can lead to increased productivity and innovation.…

The Embedded Frontier

1
#005 - The Risks of Zero-Day Attacks in Open Source Software with Frank Huerta 53:37

1 year ago53:37

53:37

Summary In this episode, Jacob Beningo interviews Frank Herta, the CEO of Curtail Incorporated, about the risks of zero-day attacks in open source software. They discuss the importance of DevSecOps and the need for comprehensive security measures. Frank shares his background in security and how his company is working on detecting zero-day bugs. They also explore the vulnerabilities of open source software and the potential for third-party supply chain attacks. Open source software testing differs from proprietary software testing in terms of who is responsible for testing. Open source projects have their own testing processes, but it's important for software developers to test the open source software in the context of their own applications. DevSecOps is a cultural shift that aims to integrate security and testing throughout the software development process. It involves early testing, collaboration between teams, and a focus on security from the beginning. The nature of threats in open source software is changing, with third-party attacks on repositories becoming a major concern. Complacency and slow response times are also issues that need to be addressed. Developers and managers using open source software should follow security best practices, stay updated on vulnerabilities, and actively test their software. Curtail is working on innovative solutions to analyze and compare different open source packages for better security. Keywords embedded systems, open source software, zero-day attacks, DevSecOps, security measures, vulnerabilities, supply chain attacks, open source software, testing, proprietary software, DevSecOps, third-party attacks, complacency, response time, security best practices, Curtail Takeaways Open source software is prevalent in the industry, with 70-90% of software being open source-based. Companies and their customers are at risk of zero-day attacks due to the widespread use of open source software. Historical examples like Heartbleed and Apache Struts have demonstrated the vulnerabilities of open source software. DevSecOps is crucial for integrating security measures throughout the software development lifecycle. Comprehensive testing, documentation, and active involvement in open source communities can help mitigate security risks. Comparing different versions of open source software and monitoring network behavior can help detect changes and potential vulnerabilities. Open source software should be tested in the context of the specific application it will be used in. DevSecOps is a cultural shift that integrates security and testing throughout the software development process. Third-party attacks on open source repositories are a growing concern. Complacency and slow response times can lead to security vulnerabilities. Developers and managers should follow security best practices and actively test their software. Curtail is working on innovative solutions to analyze and compare different open source packages for better security.…

The Embedded Frontier

1
#0004 - Embedded DevOps to the Rescue 29:53

1 year ago29:53

29:53

In this episode, Jacob Benningo discusses the importance of DevOps in the embedded software development industry. He emphasizes the need for DevOps to improve project delivery, efficiency, and product quality. Jacob provides insights into the principles of DevOps, the implementation of CI/CD pipelines, and the impact of DevOps on software development processes. He also shares actionable steps for implementing DevOps in embedded software development. Takeaways Embedded DevOps is crucial for improving project delivery, efficiency, and product quality in embedded software development. The principles of DevOps include incremental value delivery, improved collaboration, automation, and continuous improvement. Implementing a CI/CD pipeline is essential for automating software development processes and improving code quality. DevOps transforms how embedded systems are developed, leading to cleaner and more efficient software development processes. Actionable steps for implementing DevOps include defining an ideal pipeline, creating a roadmap, and setting up a DevOps framework for remote software building.…

The Embedded Frontier

1
#0003 - The Fight for True Open-Source RTOSes 39:29

1 year ago39:29

39:29

Carsten Gregerson shares his background in the embedded systems industry and how he got into it. He discusses his work at Nabto, a company that provides remote access to small devices using peer-to-peer technology. Carsten then delves into the topic of real-time operating systems (RTOS) and the battle for open-source RTOS. He explains the difference between a real-time operating system and a high-end operating system and how the introduction of the internet into embedded devices has increased the need for RTOS. He also discusses the consolidation happening in the industry with the acquisition of RTOS by big tech companies. Jacob shares his thoughts on Zephyr, an open-source RTOS, and its place in the market. He also explores the challenges of adopting Zephyr for embedded developers and the potential future of embedded development with the integration of interpreters and AI.…

The Embedded Frontier

1
#0002 - Baremetal, POSIX, and the Future of RTOS 33:49

1 year ago33:49

33:49

Summary This podcast episode discusses using bare metal and real-time operating systems (RTOS) in embedded systems development. It highlights the steady adoption of RTOS in the industry and the continued relevance of bare metal development, particularly in 8-bit microcontrollers. The episode explores the future of RTOS, including the rise of open-source options like Eclipse ThreadX and Zephyr. It also discusses different models for designing RTOS-based applications, such as the independent, dependent, and POSIX interface models. The episode concludes by encouraging listeners to stay informed about RTOS advancements and learn how to architect applications using RTOS effectively. Takeaways Bare metal development and real-time operating systems (RTOS) are both relevant and widely used in embedded systems development. RTOS adoption has remained steady, with about two-thirds of embedded systems using an RTOS and the remaining third using bare metal techniques. The future of RTOS includes the rise of open-source options like Eclipse ThreadX and Zephyr, which offer commercial-quality RTOS at open-source costs. Different models for designing RTOS-based applications include the independent model, dependent model, and POSIX interface model.…

The Embedded Frontier

1
#0001 - Max the Magnificent's AI Emporium 1:01:53

1 year ago1:01:53

1:01:53

In this conversation, Max (Clive) Maxfield discusses his journey into embedded systems and the industry's evolution. He highlights the fascinating developments in AI and its impact on embedded systems. Max also explores how AI can benefit embedded software and hardware developers and the potential applications of AI with sensors. He discusses the advancements in semiconductor technology to keep pace with AI. Finally, Max shares recommendations for managers and developers on adopting AI technologies into their development workflows. In this conversation, Max the Magnificent discusses various aspects of AI and its applications in embedded systems and beyond. He emphasizes the importance of understanding the power of data and cloud computing and the potential of generative AI. Max also shares insights on simplifying website chatbots using AI and highlights the need for managers to stay informed about AI advancements. The conversation concludes with discussing the future of AI collaboration and the importance of viewing AI as a tool rather than a replacement. Takeaways Embedded systems have evolved significantly over the years, with AI becoming a prominent feature in the industry. AI offers exciting possibilities for embedded software and hardware developers, enabling them to enhance their products and improve efficiency. Sensors are crucial in integrating AI into embedded systems, allowing for advanced functionalities and applications. The semiconductor industry is continuously advancing to meet the demands of AI, with smaller technology nodes and specialized chips. To adopt AI technologies effectively, managers and developers should stay updated on the latest developments, explore available tools and resources, and consider their projects' specific needs and applications. Tiny ML is a valuable introduction to embedded systems and can be used for applications such as predictive maintenance. Data is a crucial asset, and leveraging cloud computing and AI can enhance its value and provide powerful insights. Partnering with companies specializing in AI implementation can help navigate the complexities of AI integration. Generative AI is becoming increasingly prevalent, with applications ranging from chatbots to automated summaries. AI tools like Chat Simple can simplify the process of implementing chatbots on websites.…

The Embedded Frontier

1
#0000 - Embedded Software Trends for 2024 37:42

2 years ago37:42