S3 EP3 - Professor Johannes Brandstetter on AI for Computational Fluid Dynamics

The Neil Ashton Podcast

In this conversation, Neil Ashton interviews Prof. Johannes Brandstetter, a physicist turned machine learning expert, about his journey from academia to industry, focusing on the application of machine learning in engineering and computational fluid dynamics (CFD). They discuss the Aurora project, the challenges of integrating machine learning with engineering, and the importance of data in training models. Johannes shares insights on the use of transformers in modeling, the significance of resolution independence, and the role of open-source practices in advancing the field. The conversation also touches on the challenges of founding a startup and the need for multidisciplinary collaboration in tackling complex engineering problems.
Links:
Github: https://brandstetter-johannes.github.io
Emmi AI: https://www.emmi.ai
Google scholar: https://scholar.google.com/citations?user=KiRvOHcAAAAJ&hl=de

AB-UPT transform paper: https://arxiv.org/abs/2502.09692
Chapters
00:00 Introduction to Johannes Brandstetter
07:10 The Aurora Project and Key Learnings
11:15 Machine Learning in Engineering and CFD
17:19 Challenges with Mesh Graph Networks
20:16 Transformers in Physics Modeling
31:14 Tokenization in CFD with Transformers
39:58 Challenges in High-Dimensional Meshes
41:08 Inference Time and Mesh Generation
41:36 Neural Operators and CAD Geometry
45:59 Anchor Tokens and Scaling in CFD
48:40 Data Dependency and Multi-Fidelity Models
50:32 The Role of Physics in Machine Learning
54:28 Temporal Modeling in Engineering Simulations
56:58 Learning from Temporal Dynamics
1:00:58 Stability in Rollout Predictions
1:03:48 Multidisciplinary Approaches in Engineering
1:05:18 The Startup Journey and Lessons Learned

Chapters

1. Introduction to Johannes Brandstetter (00:00:00)

2. The Aurora Project and Key Learnings (00:07:10)

3. Machine Learning in Engineering and CFD (00:11:15)

4. Challenges with Mesh Graph Networks (00:17:19)

5. Transformers in Physics Modeling (00:20:16)

6. Tokenization in CFD with Transformers (00:31:14)

7. Challenges in High-Dimensional Meshes (00:39:58)

8. Inference Time and Mesh Generation (00:41:08)

9. Neural Operators and CAD Geometry (00:41:36)

10. Anchor Tokens and Scaling in CFD (00:45:59)

11. Data Dependency and Multi-Fidelity Models (00:48:40)

12. The Role of Physics in Machine Learning (00:50:32)

13. Temporal Modeling in Engineering Simulations (00:54:28)

14. Learning from Temporal Dynamics (00:56:58)

15. Stability in Rollout Predictions (01:00:58)

16. Multidisciplinary Approaches in Engineering (01:03:58)

17. The Startup Journey and Lessons Learned (01:05:18)