Blog

When (and When Not) to Optimize Data Pipelines

November 17, 2025

When (and When Not) to Optimize Data Pipelines

Engineers often optimize the wrong parts of their pipelines, here's a profiling-first framework to identify real bottlenecks and avoid the premature optimization trap.

Alex Noonan

Thank you! Your submission has been received!

Oops! Something went wrong while submitting the form.

August 22, 2025

dbt Fusion Support Comes to Dagster

Learn how to use the beta dbt Fusion engine in your Dagster pipelines, and the technical details of how support was added

Colton Padden

What CoPilot Won’t Teach You About Python (Part 2)

August 20, 2025

What CoPilot Won’t Teach You About Python (Part 2)

Explore another set of powerful yet overlooked Python features—from overload and cached_property to contextvars and ExitStack

Dennis Hume

August 8, 2025

Dagster’s MCP Server

We are announcing the release of our MCP server, enabling AI assistants like Cursor to seamlessly integrate with Dagster projects through Model Context Protocol, unlocking composable workflows across your entire data stack.

Colton Padden

August 7, 2025

Untangling Python Packages Part 2

A deep dive into how Dagster leverages pyproject.toml for modern Python packaging, from project metadata and dependencies to build systems and development tooling.

Dennis Hume

August 7, 2025

Software-Defined Assets Explained

Software-Defined Assets are a new abstraction that allows data teams to focus on the end products, not just the individual tasks, in their data pipeline.

Dennis Hume

July 31, 2025

Untangling Python Packages Part 1

Python's clean syntax makes it easy to jump into unfamiliar codebases, but this simplicity often masks the intricate world of packaging that confuses many developers.

Dennis Hume

July 30, 2025

A Practical Guide to Dagster Resources

How dependency injection and smart resource management can save your sanity (and your deployments)

Alex Noonan

July 25, 2025

How to Structure Your Dagster Project

Setting up your Dagster project the right way from day one saves you headaches later, makes your team more effective, and helps scale.

Alex Noonan

What CoPilot Won’t Teach You About Python (Part 1)

July 23, 2025

What CoPilot Won’t Teach You About Python (Part 1)

Advanced Python features that AI agents may miss

Dennis Hume

July 10, 2025

Announcing ETL Course with Dagster

Dagster is excited to announce the launch of ETL with Dagster, a comprehensive seven-lesson course. This free course guides you through practical ETL implementation and architectural considerations, from single-file ingestion to full-scale database replication

Dennis Hume