Meet Compass — Dagster’s new AI data analyst for Slack. Turn questions into trusted insights, instantly. → Try Compass now.

Blog

When (and When Not) to Optimize Data Pipelines
When (and When Not) to Optimize Data Pipelines

November 17, 2025

When (and When Not) to Optimize Data Pipelines

Engineers often optimize the wrong parts of their pipelines, here's a profiling-first framework to identify real bottlenecks and avoid the premature optimization trap.

Alex Noonan
Read more
All Blogs
Releases
Engineering
Product
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
ELT Options in Dagster
ELT Options in Dagster

June 5, 2024

ELT Options in Dagster

Why running data ingestion jobs straight from the orchestrator is often a preferred approach.

TéJaun RiChard
Engineering
Dagster’s Code Location Architecture
Dagster’s Code Location Architecture

May 28, 2024

Dagster’s Code Location Architecture

A structure for a reliable, maintainable data platform design.

Pete Hunt
Product
What is Dagster: A Guide to the Data Orchestrator
What is Dagster: A Guide to the Data Orchestrator

May 17, 2024

What is Dagster: A Guide to the Data Orchestrator

Get to know the tool that sets the standard for modern data orchestration.

Pete Hunt
Product
Building Cost Effective AI Pipelines with OpenAI, LangChain, and Dagster
Building Cost Effective AI Pipelines with OpenAI, LangChain, and Dagster

May 8, 2024

Building Cost Effective AI Pipelines with OpenAI, LangChain, and Dagster

Leverage the power of LLMs while keeping the costs in check using the Dagster OpenAI integration.

Maxime Armstrong
Engineering
Unlocking Flexible Pipelines: Customizing the Asset Decorator
Unlocking Flexible Pipelines: Customizing the Asset Decorator

April 30, 2024

Unlocking Flexible Pipelines: Customizing the Asset Decorator

Use Asset Factories within Dagster to streamline data asset creation, promote code reusability, and maintain data engineering workflows.

Daniel Gafni
Engineering
Change Tracking Branch Deployments in Dagster+
Change Tracking Branch Deployments in Dagster+

April 17, 2024

Change Tracking Branch Deployments in Dagster+

Dagster+ further enhances identification and collaboration around changes to your data pipelines.

Jamie Demaria
Product
See Both the Forest and the Trees with Dagster+ Insights
See Both the Forest and the Trees with Dagster+ Insights

April 17, 2024

See Both the Forest and the Trees with Dagster+ Insights

How Dagster+ Insights helps you control costs and elevate your data platform’s observability.

Christian Minich
Product
Dagster+ Catalog: A New Built-in Asset Library for All Practitioners
Dagster+ Catalog: A New Built-in Asset Library for All Practitioners

April 17, 2024

Dagster+ Catalog: A New Built-in Asset Library for All Practitioners

Give your data teams a powerful new system of record without the overhead of maintaining a third-party catalog.

Jarred Colli
Product
Ensuring Reliable Data with Dagster+
Ensuring Reliable Data with Dagster+

April 17, 2024

Ensuring Reliable Data with Dagster+

Dagster+ helps you monitor the freshness, quality, and schema of your data.

Sandy Ryza
Product
The Data Engineering Impedance Mismatch
The Data Engineering Impedance Mismatch

April 10, 2024

The Data Engineering Impedance Mismatch

A case for asset-oriented over workflow-oriented in data orchestration.

Pete Hunt
Engineering
Announcing Dagster 1.7: Love Plus One
Announcing Dagster 1.7: Love Plus One

April 8, 2024

Announcing Dagster 1.7: Love Plus One

A major set of updates to Dagster Core ahead of our Dagster+ launch.

Fraser Marlow
Releases
Expanding the Dagster Embedded ELT Ecosystem with dltHub for Data Ingestion
Expanding the Dagster Embedded ELT Ecosystem with dltHub for Data Ingestion

April 5, 2024

Expanding the Dagster Embedded ELT Ecosystem with dltHub for Data Ingestion

We now have an officially supported dlt integration.

Colton Padden
Engineering
No results, please try different filters.

Dagster Newsletter

Get updates delivered to your inbox