Engineering

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Evaluating Model Behavior Through Chess

January 7, 2026

Evaluating Model Behavior Through Chess

Benchmarks measure outcomes, not behavior. By letting AI models play chess in repeatable tournaments, we can observe how they handle risk, repetition, and long-term objectives, revealing patterns that static evals hide.

Engineering
When Sync Isn’t Enough

January 5, 2026

When Sync Isn’t Enough

This post introduces a custom async executor for Dagster that enables high-concurrency fan-out, async-native libraries, and incremental adoption, without changing how runs are launched or monitored.

Engineering
Introducing Our New eBook: Scaling Data Teams

November 5, 2025

Introducing Our New eBook: Scaling Data Teams

Learn how real data teams, from solo practitioners to enterprise-scale organizations, build in Dagster’s new eBook, Scaling Data Teams.

Engineering
dbt Fusion Support Comes to Dagster

August 22, 2025

dbt Fusion Support Comes to Dagster

Learn how to use the beta dbt Fusion engine in your Dagster pipelines, and the technical details of how support was added

Engineering
What CoPilot Won’t Teach You About Python (Part 2)

August 20, 2025

What CoPilot Won’t Teach You About Python (Part 2)

Explore another set of powerful yet overlooked Python features—from overload and cached_property to contextvars and ExitStack

Engineering
Dagster’s MCP Server

August 8, 2025

Dagster’s MCP Server

We are announcing the release of our MCP server, enabling AI assistants like Cursor to seamlessly integrate with Dagster projects through Model Context Protocol, unlocking composable workflows across your entire data stack.

Engineering
Untangling Python Packages Part 2

August 7, 2025

Untangling Python Packages Part 2

A deep dive into how Dagster leverages pyproject.toml for modern Python packaging, from project metadata and dependencies to build systems and development tooling.

Engineering
Untangling Python Packages Part 1

July 31, 2025

Untangling Python Packages Part 1

Python's clean syntax makes it easy to jump into unfamiliar codebases, but this simplicity often masks the intricate world of packaging that confuses many developers.

Engineering
What CoPilot Won’t Teach You About Python (Part 1)

July 23, 2025

What CoPilot Won’t Teach You About Python (Part 1)

Advanced Python features that AI agents may miss

Engineering
Building with Dagster vs Airflow

March 4, 2025

Building with Dagster vs Airflow

Rebuilding Airflow's tutorial in Dagster

Engineering
AI Reference Architectures

January 24, 2025

AI Reference Architectures

Guide to the some common AI Architectures patterns with Dagster

Engineering
From Prototype to Production: Building AI Products That Scale with Dagster

January 24, 2025

From Prototype to Production: Building AI Products That Scale with Dagster

Modern AI development requires different patterns than traditional software. By combining familiar engineering practices with new approaches for handling the probabilistic nature of AI, teams can successfully scale their AI products into production.

Engineering
No results, please try different filters.

Dagster Newsletter

Get updates delivered to your inbox