Blog

When (and When Not) to Optimize Data Pipelines

November 17, 2025

When (and When Not) to Optimize Data Pipelines

Engineers often optimize the wrong parts of their pipelines, here's a profiling-first framework to identify real bottlenecks and avoid the premature optimization trap.

Alex Noonan

Read more

Thank you! Your submission has been received!

Oops! Something went wrong while submitting the form.

Building with Dagster vs Airflow

Building with Dagster vs Airflow

March 4, 2025

Building with Dagster vs Airflow

Rebuilding Airflow's tutorial in Dagster

Dennis Hume

Dagster 1.10: Mambo No 5

Dagster 1.10: Mambo No 5

February 12, 2025

Dagster 1.10: Mambo No 5

Intuitive Concurrency Controls, Improved ELT integrations, and Developer Experience Upgrades

Alex Noonan

AI Reference Architectures

AI Reference Architectures

January 24, 2025

AI Reference Architectures

Guide to the some common AI Architectures patterns with Dagster

Dennis Hume

From Prototype to Production: Building AI Products That Scale with Dagster

From Prototype to Production: Building AI Products That Scale with Dagster

January 24, 2025

From Prototype to Production: Building AI Products That Scale with Dagster

Modern AI development requires different patterns than traditional software. By combining familiar engineering practices with new approaches for handling the probabilistic nature of AI, teams can successfully scale their AI products into production.

Alex Noonan

Data Platform Week 2024

Data Platform Week 2024

December 17, 2024

Data Platform Week 2024

The future of data platforms are composable, unified, and leveraged

Alex Noonan

Interactive Debugging With Dagster and Docker

Interactive Debugging With Dagster and Docker

December 2, 2024

Interactive Debugging With Dagster and Docker

Step-by-step guide to debugging Dagster code directly in Docker, bridging the gap between development and deployment.

Gianfranco Demarco

Announcing 4 New Integrations: Dagster + Your Favorite BI Tools

Announcing 4 New Integrations: Dagster + Your Favorite BI Tools

November 14, 2024

Announcing 4 New Integrations: Dagster + Your Favorite BI Tools

Pedram Navid

Bridging Business Intelligence and Data Orchestration with Dagster + Sigma

Bridging Business Intelligence and Data Orchestration with Dagster + Sigma

November 14, 2024

Bridging Business Intelligence and Data Orchestration with Dagster + Sigma

Break down the silos between data engineering and BI tools

Brandon Phillips

Dagster 1.9: Spooky

Dagster 1.9: Spooky

October 31, 2024

Dagster 1.9: Spooky

Declarative automation has officially graduated, BI in your asset graph, Airlift to streamline migrations, and more.

Sandy Ryza

AI's Long-Term Impact on Data Engineering Roles

AI's Long-Term Impact on Data Engineering Roles

October 28, 2024

AI's Long-Term Impact on Data Engineering Roles

Expectations for Data Engineering will rapidly inflate; the nature of the work will change.

Fraser Marlow

From Chaos to Control: How Dagster Unifies Orchestration and Data Cataloging

From Chaos to Control: How Dagster Unifies Orchestration and Data Cataloging

October 14, 2024

From Chaos to Control: How Dagster Unifies Orchestration and Data Cataloging

Navigate complex data environments more effectively, and ensure that valuable data assets are easily discoverable and usable.

Alex Noonan

10 Reasons Why No-Code Solutions Almost Always Fail

10 Reasons Why No-Code Solutions Almost Always Fail

October 3, 2024

10 Reasons Why No-Code Solutions Almost Always Fail

No-code solutions sound easy – until they aren’t. Here’s why they often fail and what you can do about it for your data engineering.

TéJaun RiChard

Dagster Newsletter

Get updates delivered to your inbox