Engineering Insights
Hard-won lessons, system design teardowns, and architecture guides from the frontlines of data engineering.
- Articles
- 10
- Authors
- 6
3 posts
Build an AI Tactical Analyst with NFL Data, dbt, and RAG: A Full Data Engineering Pipeline
While everyone else argues about the halftime show, we're building the scouting report. This tutorial walks through a full end-to-end data + AI pipeline using NFL play-by-play data, dbt, and a RAG-powered analyst.
Building a Cost-Efficient RAG Pipeline with Pinecone
RAG pipelines can get expensive fast: embedding costs, vector storage costs, LLM inference costs. After running our production RAG system for 9 months, we cut costs by 73% with three architectural changes. None of them involve switching models.
Stop Building Toy Pipelines: The 2026 Data Engineering Portfolio Guide
Hiring managers see hundreds of GitHub repos with a Jupyter notebook and a README promising an "end-to-end pipeline." None of them get interviews. Here's what does, with three project specs you can actually ship this quarter.