))
164: I built an entire data pipeline in 30 minutes using only AI (no code required)
Manage episode 491904787 series 3674951
Content provided by Avery Smith - Data Career Coach. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Avery Smith - Data Career Coach or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.
Today, we'll create an entire data pipeline from scratch without writing a single line of code! Using Keboola MCP server and ClaudeAI, we’ll extract data from my FindADataJob.com RSS feed, transform it, load it into Google BigQuery, and visualize it with Streamlit. This is the future of data engineering!
Keboola MCP Integration:
https://mcp.connection.us-east4.gcp.keboola.com/sse
I Analyzed Data Analyst Jobs to Find Out What Skills You ACTUALLY Need
https://www.youtube.com/watch?v=lo3VU1srV1E&t=212s
💌 Join 10k+ aspiring data analysts & get my tips in your inbox weekly 👉 https://www.datacareerjumpstart.com/newsletter
🆘 Feeling stuck in your data journey? Come to my next free "How to Land Your First Data Job" training 👉 https://www.datacareerjumpstart.com/training
👩💻 Want to land a data job in less than 90 days? 👉 https://www.datacareerjumpstart.com/daa
👔 Ace The Interview with Confidence 👉 https://www.datacareerjumpstart.com/interviewsimulator
⌚ TIMESTAMPS
00:00 - Introduction
00:54 - Definition of Basic Data Engineering Terms
02:26 - Keboola MCP and Its Capabilities
07:48 - Extracting Data from RSS Feed
12:43 - Transforming and Cleaning the Data
19:19 - Aggregating and Analyzing Data
23:19 - Scheduling and Automating the Pipeline
25:04 - Visualizing Data with Streamlit
🔗 CONNECT WITH AVERY
🎥 YouTube Channel: https://www.youtube.com/@averysmith
🤝 LinkedIn: https://www.linkedin.com/in/averyjsmith/
📸 Instagram: https://instagram.com/datacareerjumpstart
🎵 TikTok: https://www.tiktok.com/@verydata
💻 Website: https://www.datacareerjumpstart.com/
Mentioned in this episode:
✨ Try Julius!
This episode is brought to you by Julius – your AI data analyst companion. Connect to your database and/or business tools, pull insights in minutes–no coding required. Thanks, Julius, for sponsoring this episode. Try Julius at https://landadatajob.com/Julius-DCP
https://landadatajob.com/Julius-DCP
Join The September Cohort of DAA
The September cohort is your last call if you wanna lock down a data job this year in 2025. So don't overthink it, don't put it off. Go join the accelerator, meet me and the crew on September 8th, and let's get you in the seat before someone else takes it.
175 episodes
Share
