Engineering essays · not corporate blog
Engineering Insights
Hard-won lessons, system design teardowns, and architecture guides from the frontlines of data engineering.
- Articles
- 10
- Authors
- 6
Sort
2 posts
ArchitectureApr 15, 2026
How to Design a Modern Data + AI System: Control, Data, and Decision Planes
Most data teams build AI features by bolting an LLM onto their existing pipeline and calling it done. The systems that actually work in production separate three planes. Here's why, with a reference architecture.
Read →
ArchitectureMar 18, 2026
Why We Migrated from Airflow to Kubernetes-Native Orchestration
After three years running Airflow at scale, we hit the ceiling: resource contention, slow DAG parsing, and a scheduler that became a single point of failure. Here's the full story of how we rebuilt orchestration on Argo Workflows — what we gained, what we lost, and the lessons you can steal.
Read →