The Vector ETL: Offloading Document Chunking to dbt Python Models
Learn how to offload resource-heavy document chunking from application workers to your data warehouse using dbt Python models for RAG, ensuring lineage and scalability for AI pipelines.
The Semantic Data Warehouse: Modeling Vector-Relational Hybrids with dbt and Snowflake
Stop treating vectors as sidecars. Learn how to model embeddings directly in Snowflake using dbt to optimize RAG performance, handle model drift, and manage semantic-relational joins at scale.
The Silent Search Killer: Using dbt Tests to Guard Your Vector Ingestion Pipeline
Stop silent search degradation by implementing dbt macros to validate vector dimensions, L2 norms, and semantic drift across your ingestion pipelines.
Event-Driven Ingestion: Scaling Search Pipelines with Kafka and dbt
An enterprise data architecture tutorial focused on building a high-throughput search ingestion pipeline. We demonstrate how to break up transactional database dependencies by using Apache Kafka for immutable event routing, coupled with dbt incremental models to manage near-real-time data transformations smoothly at scale.