20 subscribers
Go offline with the Player FM app!
Podcasts Worth a Listen
SPONSORED


Connecting AI to Your Company's Internal Information
Manage episode 487952380 series 2798195
AI wants your data, but it can't handle the truth . . .
“We’ll just plug our data into ChatGPT.” Sure. Sounds easy. Rob thought so too, right up until he hit token limits, had to install Python, and discovered that even two megabytes of transcripts was too much for the world’s smartest models to handle. In this episode, Rob and Justin break down what happens when you try to use AI on your company’s internal data. Spoiler: it’s a lot more complicated than the vendors make it sound.
From semantic search to retrieval augmented generation (RAG), they unpack why the dream of “ask AI anything about your business” keeps falling short. You’ll hear why your Power BI model isn’t going anywhere, why structured data still needs old-school engines, and what it really takes to get value from your own information. Somewhere between a cautionary tale and a tech detective story, this one tells it like it is . . . unapologetically.
Run into the same situation? We’d love to hear about it! Give us a shout on LinkedIn and tell us how you overcame the limitations.
195 episodes
Manage episode 487952380 series 2798195
AI wants your data, but it can't handle the truth . . .
“We’ll just plug our data into ChatGPT.” Sure. Sounds easy. Rob thought so too, right up until he hit token limits, had to install Python, and discovered that even two megabytes of transcripts was too much for the world’s smartest models to handle. In this episode, Rob and Justin break down what happens when you try to use AI on your company’s internal data. Spoiler: it’s a lot more complicated than the vendors make it sound.
From semantic search to retrieval augmented generation (RAG), they unpack why the dream of “ask AI anything about your business” keeps falling short. You’ll hear why your Power BI model isn’t going anywhere, why structured data still needs old-school engines, and what it really takes to get value from your own information. Somewhere between a cautionary tale and a tech detective story, this one tells it like it is . . . unapologetically.
Run into the same situation? We’d love to hear about it! Give us a shout on LinkedIn and tell us how you overcame the limitations.
195 episodes
All episodes
×
1 Everything's Real, Everything Matters, and Everyone Knows It w/ Quadrant Concrete CFO Joseph Graziano 1:06:20

1 It's Time to Start Giving Power BI CoPilot a Serious Look (For End User Interaction) 25:25

1 Connecting AI to Your Company's Internal Information 43:44

1 An Inflection Point in AI? Understanding MCP and Multi-Agent 25:25

1 Confessions of a Data Gener w/ Sakiko Stickley 1:02:18

1 The Biggest Improvements Announced at FabCon, and the Ever-Widening Gap Between Adoption and Capabilities 28:21

1 Data, Data, and Metadata: Letting ChatGPT Interpret Power BI Output 16:17



1 Miller's Theorem: A Principle for Getting Off the Fence 16:01


1 Why the Data Gene is (Still) Under-Represented in Management 16:36

1 The Data Gene Transforms Non-Football Fans into Fantasy Football Devotees, w/ Adam Harstad 1:24:17

1 What Drives Costs for Data Projects, and How are They Changing Over Time? 49:13

1 Power BI is Back on the Menu, plus The Importance of Usage Data, w/ Gil Raviv 1:12:23

1 Happy Holidays, and Remembering Bob Pop Collie 2:38

1 The Microsoft MVP Take: Innovation, Hype, and the Future of Data 44:37

1 Misaligned Incentives, Failures of Government, and Coca-Cola's AI Misstep 37:00

1 Riding the Tsunami: Why Expanding into Unmet Demand Makes Our Jobs Safe 18:52

1 The Crutches Paradox (and Why Senior Software Engineers Don’t Care About AI) 45:42

1 A Lifelong Learner Embraces AI, w/Brian Julius 1:06:27


1 Resilience Sometimes Beats Prevention, and Six Ways to Get off the Starting Line with AI 46:44


1 Head to Head: Can ChatGPT Replicate Rob's Inspired Solution to a Power Query Challenge? 46:34


1 A Simple Trick for (Occasionally) Predicting the Future 25:03

1 Low-Tech Industries and High-Tech AI: a Great Match Explained Through Examples 38:10

Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.