71 subscribers
Go offline with the Player FM app!
Retrieval, rerankers, and RAG tips and tricks | Data Brew | Episode 39
Manage episode 467662617 series 2814833
In this episode, Andrew Drozdov, Research Scientist at Databricks, explores how Retrieval Augmented Generation (RAG) enhances AI models by integrating retrieval capabilities for improved response accuracy and relevance.
Highlights include:
- Addressing LLM limitations by injecting relevant external information.
- Optimizing document chunking, embedding, and query generation for RAG.
- Improving retrieval systems with embeddings and fine-tuning techniques.
- Enhancing search results using re-rankers and retrieval diagnostics.
- Applying RAG strategies in enterprise AI for domain-specific improvements.
43 episodes
Manage episode 467662617 series 2814833
In this episode, Andrew Drozdov, Research Scientist at Databricks, explores how Retrieval Augmented Generation (RAG) enhances AI models by integrating retrieval capabilities for improved response accuracy and relevance.
Highlights include:
- Addressing LLM limitations by injecting relevant external information.
- Optimizing document chunking, embedding, and query generation for RAG.
- Improving retrieval systems with embeddings and fine-tuning techniques.
- Enhancing search results using re-rankers and retrieval diagnostics.
- Applying RAG strategies in enterprise AI for domain-specific improvements.
43 episodes
All episodes
×
1 Benchmarking Domain Intelligence | Data Brew | Episode 45 31:41

1 SWE-bench & SWE-agent | Data Brew | Episode 44 36:22

1 Enterprise AI: Research to Product | Data Brew | Episode 43 38:03

1 Retrieval, rerankers, and RAG tips and tricks | Data Brew | Episode 39 45:22

1 The Power of Synthetic Data | Data Brew | Episode 38 42:28

1 Secret to Production AI: Tools & Infrastructure | Data Brew | Episode 37 37:14

1 Mixture of Memory Experts (MoME) | Data Brew | Episode 36 41:24

1 Mixed Attention & LLM Context | Data Brew | Episode 35 39:11

1 Kumo AI & Relational Deep Learning | Data Brew | Episode 34 43:27

1 LLMs: Internals, Hallucinations, and Applications | Data Brew | Episode 33 38:50

1 Demonstrate–Search–Predict Framework | Data Brew | Episode 32 33:14

1 Generative AI Risks | Data Brew | Episode 31 34:38

1 Data Brew Season 2 Episode 7: Interpretable Machine Learning 37:07


1 Data Brew Season 2 Episode 5: ML Applications 32:40

1 Data Brew Season 2 Episode 4: Hyperparameter and Neural Architecture Search 33:25

1 Data Brew Season 2 Episode 3: Infrastructure for ML 30:34


1 Data Brew Season 2 Episode 1: ML in Production 30:49

1 Data Brew Season 1 Episode 6: Journey of Big Data 40:16

1 Data Brew Season 1 Episode 5: Combining Machine Learning and MLflow with your Lakehouse 36:00

1 Data Brew Season 1 Episode 4: BI on Data Lakes - Making it Real for Retail 29:05

1 Data Brew Season 1 Episode 3: Demystifying Delta Lake 25:51

1 Data Brew Season 1 Episode 2: Welcome to Lakehouse 26:10

1 Data Brew Season 1 Episode 1: From data warehousing to data lakes in 40 minutes 44:48

1 John Snow Labs & SparkNLP | Data Brew | Episode 30 43:17

1 Data Brew Season 4 Episode 6: Professional Athletes 35:49

1 Data Brew Season 4 Episode 5: Public Health: Education, Access, and Policy 34:39

1 Data Brew Season 4 Episode 4: 1283 Days of Running (and Counting) 35:54

1 Data Brew Season 4 Episode 3: Last Man Standing 41:20

1 Data Brew Season 4 Episode 2: NBA Analytics 30:16

1 Data Brew Season 4 Episode 1: Reducing Injury & Increasing Retention of Industrial Athletes 33:58


1 Data Brew Season 3 Episode 5: Sustainability & Sake 32:26

1 Data Brew Season 3 Episode 4: Executive Education 38:46

1 Data Brew Season 3 Episode 3: 3 T’s to Securing AI Systems: Tests, tests, and more tests 35:01

1 Data Brew Season 3 Episode 2: Data Culture Outside ‘The Valley’ 35:39

1 Data Brew Season 3 Episode 1: Disrupt: Challenge your Business Assumptions 29:45

1 Data Brew Season 2 Episode 9: Data Driven Software 31:12

1 Data Brew Season 2 Episode 8: Feature Engineering 31:17
Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.