-
The Problem with dbt Tests Nobody Talks About — They Pass and You Still Ship Bad Data
I’ve been running dbt in production for a while now. And I’ll be honest — there was a phase where I genuinely believed that if my dbt tests were green, I was good. Green means clean, right? Wrong. This is the quiet failure mode that nobody in the dbt community writes about loudly enough. Your…
-
Automation in Data Engineering: It’s Not AI You Should Worry About
I still remember the afternoon I burned four hours debugging a production pipeline, convinced the problem was in the model logic, only to find the real culprit was a manual data prep step where someone had quietly introduced a column name inconsistency. No alerts. No schema validation. Just silent failure downstream. That incident changed how…
-
Why I Stopped Using Snowflake Tasks for Orchestration
I want to be clear about something before I say anything critical: Snowflake Tasks are genuinely good. I used them for months. I recommended them to people. I wrote internal documentation about how to set them up. And then, slowly, quietly, I stopped reaching for them — and started reaching for Airflow instead. This isn’t…
-
Snowflake Cortex Code Cost Control: Setting Per-User Credit Limits
This post is for Snowflake admins and data engineering leads whose teams use Cortex Code. It explains how Cortex Code is billed on each surface, the per-user credit limit parameters Snowflake provides, how to set account defaults and per-user overrides, how to audit overrides, and how to watch actual usage. When I first started using…
-
Snowflake Interview Questions — Expert Level
After all of this, the real tell at the senior level isn’t whether you know all these answers. It’s whether you can connect them. The best signal a senior candidate gives is when they answer one question and naturally reference another. “That’s the same clustering depth issue I mentioned earlier — the root cause is…
-
Orchestrating Snowflake dbt Projects with Airflow — End-to-End Pipeline Guide
How I Wired Snowflake’s Native dbt projects to Airflow — And Finally Got True End-to-End Orchestration I’ll be honest with you — for a long time I was running dbt the way most people run it. dbt Core installed on a server, profiles.yml file that I kept updating manually, a cron job (yes, a cron…
-
How I Taught Myself Snowflake Cortex Code (And What I Found)
Nobody told me to do this. No manager pinged me. No sprint ticket had “explore Cortex Code” written on it. I stumbled across it one evening while clicking around Snowsight after a long day of debugging dbt models, and three hours later I looked up and realized I hadn’t thought about Jira or Slack once.…
-
2026 Guide: Cut dbt Build Time 48% with Snowflake Cortex Code
The Moment Everything Changed It was a Tuesday morning when I finally snapped. My dbt project had grown to 147 models, and the daily run was taking 2 hours and 47 minutes. Our Airflow DAG was timing out. The business team was complaining about stale dashboards. And I was spending my entire morning investigating why…
-
Snowflake Managed Iceberg Tables 2026
⚡ TL;DR (Too Long; Didn’t Read) What it is: Snowflake Managed Iceberg Tables store data in your cloud storage (S3, GCS, Azure) instead of Snowflake’s storage, while Snowflake manages the metadata and catalog. Key benefits: When to use: When NOT to use: Setup time: 15 minutes (create external volume → create table) Cost difference: 10TB…
-
Snowflake AI_PARSE_DOCUMENT: Full Guide 2026
Why Document Processing Matters in 2026 Enterprises store approximately 80-90% of their business data in unstructured formats—PDFs, Word documents, scanned images, contracts, invoices, and reports. Yet most enterprise data warehouses, including Snowflake, were built to handle structured data. Snowflake’s AI_PARSE_DOCUMENT function, a Cortex AI SQL function that extracts text, data, and layout elements from documents…
