Meet Compass — Dagster’s new AI data analyst for Slack. Turn questions into trusted insights, instantly. → Try Compass now.
Blog
November 17, 2025
When (and When Not) to Optimize Data Pipelines
Engineers often optimize the wrong parts of their pipelines, here's a profiling-first framework to identify real bottlenecks and avoid the premature optimization trap.
Oops! Something went wrong while submitting the form.
November 20, 2023
High-performance Python for Data Engineering
Learn how to optimize your Python data pipeline code to run faster with our high-performance Python guide for data engineers.
Elliot Gunn
Engineering
November 8, 2023
Orchestrate Unstructured Data Pipelines with Dagster and dlt
Load messy data sources into well-structured tables or datasets, through automatic schema inference and evolution.
Nikki Everett
Product
October 20, 2023
CI/CD and Data Pipeline Automation (with Git)
Learn how to automate data pipelines and deployments by integrating Git and CI/CD in our Python for data engineering series.
Elliot Gunn
Engineering
October 13, 2023
Introducing Dagster External Assets
Use Dagster’s External Assets feature for data observability, lineage, data quality, and cataloging while bringing your own orchestration and scheduling.
Nick Schrock
Engineering
October 13, 2023
Introducing Dagster Pipes
A new protocol and toolkit for integrating and launching compute into remote execution environments from Dagster.
Nick Schrock
Engineering
October 12, 2023
Stop Reinventing Orchestration: Embedded ELT in the Orchestrator
Solve data ingestion issues with Dagster's Embedded ELT feature, a lightweight embedded library.
Pedram Navid
Engineering
October 11, 2023
Improving the Dagster learning curve
Learn Dagster essentials and build asset-based data pipelines with Dagster University, our new self-guided course for beginners.
Erin Cochran
Product
October 10, 2023
Improving visibility into data operations with Dagster Insights
Gain operational observability on your data pipelines and bring cloud costs back under control with the Dagster Insights feature.
Jarred Colli
Product
October 9, 2023
Introducing Dagster Asset Checks
Deliver high-quality data with Dagster Asset Checks, the ability to embed data quality checks into your data pipeline.
Sandy Ryza
Engineering
October 2, 2023
Announcing Dagster 1.5: How Will I Know?
Ahead of Launch Week, we are proud to be rolling out some exciting new capabilities.
Yuhan Luo
Releases
September 29, 2023
Write-Audit-Publish in data pipelines
We look at the write-audit-publish software design pattern used in ETL to ensure quality and reliability in data engineering workflows.
Elliot Gunn
Engineering
September 28, 2023
Escaping the Modern Data Trap
Launch Week kicks off October 9th with new functionality being shared each day. Our theme: Escaping the Modern Data Trap!
.jpeg)
