Aug 9, 2022

Launching Dagster Cloud to GA

The enterprise orchestration platform that puts developer experience first with hybrid or serverless deployments, native branching, and out-of-the-box CI/CD.
Nick Schrock
Name
Nick Schrock
Handle
@schrockn
Aug 5, 2022

Introducing Dagster 1.0: Hello

We are extremely excited to announce the release of Dagster 1.0.
Sandy Ryza
Name
Sandy Ryza
Handle
@s_ryz
Aug 3, 2022

The Open Core Business Model

The relationship between Dagster, the open-source project, and Dagster Cloud, our hosted SaaS platform.
Nick Schrock
Name
Nick Schrock
Handle
@schrockn
Jul 26, 2022

Dagster Cloud goes SOC 2

Elementl, the company behind the Dagster data orchestration tool achieves SOC2 compliance.
Selina Li
Name
Selina Li
Handle
Jul 25, 2022

Dagster Day: Announcing Dagster 1.0 and Dagster Cloud

The release of Dagster 1.0 and the GA launch of Dagster Cloud represent major milestones in the evolution of our ...
Nick Schrock
Name
Nick Schrock
Handle
@schrockn
Jul 12, 2022

Roman roads in data engineering: stop starting from scratch whenever you write a data pipeline

Work in a way that lays the foundation for your next data product while you’re building your current one.
Claire Lin
Name
Claire Lin
Handle
Sandy Ryza
Name
Sandy Ryza
Handle
@s_ryz
Jun 22, 2022

My Path to Elementl: Pete Hunt

Pete Hunt discusses what caused him to make the leap from Twitter to Elementl.
Pete Hunt
Name
Pete Hunt
Handle
@floydophone
Jun 20, 2022

Orchestrating Python and dbt with Dagster

How asset-focused orchestration bridges the gap between some of data's most popular tools.
Owen Kephart
Name
Owen Kephart
Handle
Jun 15, 2022

Dagster 0.15.0: Cool for the Summer

In 0.15.0, software-defined assets are now marked fully stable and are ready for primetime.
Mollie Pettit
Name
Mollie Pettit
Handle
@MollzMP
Mar 9, 2022

New in 0.14.0: Dagster-Airbyte Integration

0.14.0 introduces a deep integration with Airbyte. When you run a sync using this library, you'll be able to view ...
Owen Kephart
Name
Owen Kephart
Handle
Mar 1, 2022

Introducing Software-Defined Assets

Over the past two decades, the way we build software has changed. Frontend engineering has moved from jQuery, an ...
Sandy Ryza
Name
Sandy Ryza
Handle
@s_ryz
Mar 1, 2022

New in 0.14.0: Table Schema API and Pandera Integration

0.14.0 introduces two asset observability-enhancing features: a new Table Schema API, and an accompanying integration ...
Sean Mackesey
Name
Sean Mackesey
Handle
Mar 1, 2022

Dagster 0.14.0: Never Felt Like This Before

We’re thrilled to release version 0.14.0 of Dagster. This version introduces much more mature version of ...
Mollie Pettit
Name
Mollie Pettit
Handle
@MollzMP
Feb 17, 2022

Rebundling the Data Platform

A fascinating post made the rounds yesterday in the data community entitled 'The Unbundling of Airflow'. It is ...
Nick Schrock
Name
Nick Schrock
Handle
@schrockn
Dec 2, 2021

Introducing Dagster Cloud

Early Access to Dagster Cloud, the new standard for productivity, scalability, and trust in enterprise data ...
Nick Schrock
Name
Nick Schrock
Handle
@schrockn
Max Gasner
Name
Max Gasner
Handle
@gasnerpants
Nov 20, 2021

Laying The Foundation Of Your Data Platform For The Era Of Big Complexity With Dagster

Listen to Nick Schrock talk about how Dagster helps tame the complexity and scale when working with data in this ...
Nick Schrock
Name
Nick Schrock
Handle
@schrockn
Nov 17, 2021

Hello Big Complexity: Is Your Modern Data Stack Ready?

Listen to Nick Schrock discuss the evolution of data from Big Data to Big Complexity in this episode of the Mad Data ...
Nick Schrock
Name
Nick Schrock
Handle
@schrockn
Nov 16, 2021

Why Elementl and Dagster: The Decade of Data

Announcing our $14M Series A led by Mike Volpi of Index Ventures, alongside Sequoia Capital, Slow Ventures, Coatue, ...
Nick Schrock
Name
Nick Schrock
Handle
@schrockn
Nov 8, 2021

New in Dagster 0.13.0: Logging Improvements!

Logging without context, instance-wide handlers, capturing python logs, and more! Learn about the improvements we've ...
Owen Kephart
Name
Owen Kephart
Handle
Oct 28, 2021

Dagster 0.13.0: A New Foundation

We’re proud to announce 0.13.0 of Dagster. We’ve made dramatic improvements to our core APIs, completely revamped our ...
Nick Schrock
Name
Nick Schrock
Handle
@schrockn
Aug 10, 2021

Community Memo: Moving Dagster's Core APIs Towards 1.0

As data practitioners increasingly depend on Dagster as a critical piece of their platforms, we believe it’s important ...
Sandy Ryza
Name
Sandy Ryza
Handle
@s_ryz
Jul 19, 2021

Dagster 0.12.0: Into the Groove

In 0.12.0, we introduce pipeline failure sensors, solid-level retries, and more convenient testing APIs.
Owen Kephart
Name
Owen Kephart
Handle
May 25, 2021

Community Memo: Approachability Improvements

In the last two months, we've made a set of changes aimed at making Dagster more approachable: to smooth out its ...
Sandy Ryza
Name
Sandy Ryza
Handle
@s_ryz
May 18, 2021

Incrementally Adopting Dagster at Mapbox

At Mapbox, we've adopted Dagster without breaking compatibility with our legacy Airflow systems -- and with huge gains ...
Ben Pleasanton
Name
Ben Pleasanton
Handle
May 13, 2021

Moving past Airflow: Why Dagster is the next-generation data orchestrator

Our most requested piece of content is a comparison between Dagster and Airflow. Here we detail the differences between ...
Nick Schrock
Name
Nick Schrock
Handle
@schrockn
Apr 1, 2021

Dagster 0.11.0: Lucky Star

In 0.11.0, we introduce dynamic orchestration, a new backfill UI, and support for tracking asset lineage.
Mar 15, 2021

Building shared spaces for data teams at Drizly

Dagster lets a small data infrastructure team efficiently ship a data platform that supports users with different ...
Dennis Hume
Name
Dennis Hume
Handle
Jan 19, 2021

Dagster 0.10.0: The Edge of Glory

In 0.10.0, we introduce unique event-based scheduling capabilities, hardened deployments on Kubernetes, and new ...
Nick Schrock
Name
Nick Schrock
Handle
@schrockn
Max Gasner
Name
Max Gasner
Handle
@gasnerpants
Dec 9, 2020

Good Data at Good Eggs: Using Dagster to manage the data platform

Running pipelines is only part of the operational burden of running a data platform. We also need to manage the ...
David Wallace
Name
David Wallace
Handle
@davidjwallace
Nov 5, 2020

Good Data at Good Eggs: Data observability with the asset catalog

What we’re aiming for with Dagster is a completely horizontal view of our data assets. Our analysts will be able to ...
David Wallace
Name
David Wallace
Handle
@davidjwallace
Oct 29, 2020

Dagster and dbt: Better Together

People sometimes ask us — should I use Dagster, or should I use dbt? We view Dagster and dbt as complementary ...
AJ Nadel
Name
AJ Nadel
Handle
@AJ_Nadel
Bob Chen
Name
Bob Chen
Handle
@bobchen168
Oct 1, 2020

Good Data at Good Eggs: Correctness and reliability for data infrastructure

Dagster’s support for custom data types helped us achieve better correctness and reliability in our data ingest ...
David Wallace
Name
David Wallace
Handle
@davidjwallace
Oct 1, 2020

Good Data at Good Eggs: Part 1 of 4

Adopting Dagster was a catalyst for the transformation of our data platform team. We hope our experience is encouraging ...
David Wallace
Name
David Wallace
Handle
@davidjwallace
Sep 16, 2020

Testing and Deploying PySpark Jobs with Dagster

Spark has a beautiful API — so why is developing with it such a pain?
Sandy Ryza
Name
Sandy Ryza
Handle
@s_ryz
Sep 15, 2020

Community Memo: September 2020 Update

Our monthly community meeting featured a retrospective of our 0.9.0 release, a preview of our 0.10.0 roadmap, and ...
Sep 10, 2020

Great Expectations for Dagster

We’re thrilled to announce a new integration between Dagster and a fellow open-source project, Great Expectations (GE).
Leor Fishman
Name
Leor Fishman
Handle
@fishmanl
Aug 11, 2020

Dagster: The Data Orchestrator

Dagster is a new type of workflow engine: a data orchestrator. Moving beyond just managing the ordering and physical ...
Nick Schrock
Name
Nick Schrock
Handle
@schrockn
Max Gasner
Name
Max Gasner
Handle
@gasnerpants
Feb 26, 2020

Dagster 0.7.0: Waiting To Exhale

With 0.7.0 we set out improve the Dagster experience with large, production-scale pipelines, deployable to Kubernetes.
Oct 10, 2019

Dagster 0.6.0: Impossible Princess

With 0.6.0, Dagster comes “batteries-included” — but still with pluggable options — for everything you need to execute, ...
Jul 8, 2019

Introducing Dagster

Today the team at Elementl is proud to announce an early release of Dagster, an open-source library for building ...