⌨ Keyboard shortcuts available
G — waiting for next key…

Writing

Articles tagged “Data Engineering”

11 articles on Data Engineering. All articles →

Branded cover card: The Silent Search Killer: Using dbt Tests to Guard Your Vector Ingestion Pipeline
Vector Search Data Engineering

The Silent Search Killer: Using dbt Tests to Guard Your Vector Ingestion Pipeline

Stop silent search degradation by implementing dbt macros to validate vector dimensions, L2 norms, and semantic drift across your ingestion pipelines.

Jul 14, 2026 · 31 min
An infrastructure diagram illustrating data flowing from an app server to a Kafka topic, landing in a raw zone, and transforming via dbt into clean search models.
Data Engineering Apache Kafka

Event-Driven Ingestion: Scaling Search Pipelines with Kafka and dbt

An enterprise data architecture tutorial focused on building a high-throughput search ingestion pipeline. We demonstrate how to break up transactional database dependencies by using Apache Kafka for immutable event routing, coupled with dbt incremental models to manage near-real-time data transformations smoothly at scale.

Jul 7, 2026 · 9 min
← Prev 2 / 2 Next →