Meet Compass — Dagster’s new AI data analyst for Slack. Turn questions into trusted insights, instantly. → Try Compass now.

Blog

When (and When Not) to Optimize Data Pipelines
When (and When Not) to Optimize Data Pipelines

November 17, 2025

When (and When Not) to Optimize Data Pipelines

Engineers often optimize the wrong parts of their pipelines, here's a profiling-first framework to identify real bottlenecks and avoid the premature optimization trap.

Alex Noonan
Read more
All Blogs
Releases
Engineering
Product
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
5 Best Practices AI Engineers Should Learn From Data Engineering
5 Best Practices AI Engineers Should Learn From Data Engineering

September 30, 2024

5 Best Practices AI Engineers Should Learn From Data Engineering

AI engineering is data engineering. Here are 5 best practices the former should adopt from the latter to succeed.

TéJaun RiChard
Product
Dagster Deep Dive Recap: Orchestrating Flexible Compute for ML with Dagster and Modal
Dagster Deep Dive Recap: Orchestrating Flexible Compute for ML with Dagster and Modal

September 27, 2024

Dagster Deep Dive Recap: Orchestrating Flexible Compute for ML with Dagster and Modal

Learn how to use Dagster and Modal to automate and streamline your machine learning model training and data processing.

TéJaun RiChard
Engineering
The Rise of the Data Platform Engineer
The Rise of the Data Platform Engineer

September 26, 2024

The Rise of the Data Platform Engineer

How the next step in the evolution of the Data Engineering role requires a platform approach.

Pedram Navid
Engineering
Dagster vs. Airflow
Dagster vs. Airflow

September 23, 2024

Dagster vs. Airflow

Get the tale of the tape between the two orchestration giants and see why Dagster stands tall as the superior choice.

Alex Noonan
Engineering
What is Data Visibility?
What is Data Visibility?

September 12, 2024

What is Data Visibility?

The unseen data is often the deadliest. Here’s how to shine a light on it in your business.

TéJaun RiChard
Engineering
Dagster Deep Dive Recap: Building a True Data Platform
Dagster Deep Dive Recap: Building a True Data Platform

September 6, 2024

Dagster Deep Dive Recap: Building a True Data Platform

Move past the MDS and build a data platform for observability, cost-efficiency, and top-tier orchestrating.

TéJaun RiChard
Engineering
Dagster Deep Dive Recap: Evolution of the Data Platform
Dagster Deep Dive Recap: Evolution of the Data Platform

August 30, 2024

Dagster Deep Dive Recap: Evolution of the Data Platform

Dagster and SDF show how the power of two can connect local development and production orchestration.

TéJaun RiChard
Engineering
Dagster 1.8: Call Me Maybe
Dagster 1.8: Call Me Maybe

August 8, 2024

Dagster 1.8: Call Me Maybe

Ecosystem and integration improvements, data catalog improvements, new asset checks, new declarative automation, and more.

TéJaun RiChard
Releases
Dagster Deep Dive Recap: Building Reliable Data Platforms
Dagster Deep Dive Recap: Building Reliable Data Platforms

August 7, 2024

Dagster Deep Dive Recap: Building Reliable Data Platforms

Explore the importance of data quality and learn strategies for integrating quality checks using Dagster.

TéJaun RiChard
Engineering
A Look Inside the Dagster Labs Culture
A Look Inside the Dagster Labs Culture

July 18, 2024

A Look Inside the Dagster Labs Culture

Operations Lead Eunice Ho dives into the Dagster Labs culture and why it makes for an ideal work environment.

Eunice Ho
Product
Enabling Data Quality with Dagster and Great Expectations
Enabling Data Quality with Dagster and Great Expectations

July 8, 2024

Enabling Data Quality with Dagster and Great Expectations

Use Dagster and GX to improve data pipeline reliability without writing custom logic for data testing.

Muhammad Jarir Kanji
Engineering
The Rise of Medium Code
The Rise of Medium Code

June 10, 2024

The Rise of Medium Code

Why the reports of software’s demise are greatly exaggerated.

Nick Schrock
Product
No results, please try different filters.

Dagster Newsletter

Get updates delivered to your inbox