31 Posts
Mar 1, 2022
Introducing Software-Defined Assets
Over the past two decades, the way we build software has changed. Frontend engineering has moved from jQuery, an imperative library that makes it easy to manipulate webpages, to React, which allows writing JavaScript that declares...
- Name
- Sandy Ryza
- Handle
- @s_ryz
Mar 9, 2022
New in 0.14.0: Dagster-Airbyte Integration
0.14.0 introduces a deep integration with Airbyte. When you run a sync using this library, you'll be able to view ...
- Name
- Owen Kephart
- Handle
Mar 1, 2022
New in 0.14.0: Table Schema API and Pandera Integration
0.14.0 introduces two asset observability-enhancing features: a new Table Schema API, and an accompanying integration ...
- Name
- Sean Mackesey
- Handle
Mar 1, 2022
Dagster 0.14.0: Never Felt Like This Before
We’re thrilled to release version 0.14.0 of Dagster. This version introduces much more mature version of ...
- Name
- Mollie Pettit
- Handle
- @mollie
Feb 17, 2022
Rebundling the Data Platform
A fascinating post made the rounds yesterday in the data community entitled 'The Unbundling of Airflow'. It is ...
- Name
- Nick Schrock
- Handle
- @schrockn
Dec 2, 2021
Introducing Dagster Cloud
Early Access to Dagster Cloud, the new standard for productivity, scalability, and trust in enterprise data ...
- Name
- Nick Schrock
- Handle
- @schrockn
- Name
- Max Gasner
- Handle
- @gasnerpants
Nov 20, 2021
Laying The Foundation Of Your Data Platform For The Era Of Big Complexity With Dagster
Listen to Nick Schrock talk about how Dagster helps tame the complexity and scale when working with data in this ...
- Name
- Nick Schrock
- Handle
- @schrockn
Nov 17, 2021
Hello Big Complexity: Is Your Modern Data Stack Ready?
Listen to Nick Schrock discuss the evolution of data from Big Data to Big Complexity in this episode of the Mad Data ...
- Name
- Nick Schrock
- Handle
- @schrockn
Nov 16, 2021
Why Elementl and Dagster: The Decade of Data
Announcing our $14M Series A led by Mike Volpi of Index Ventures, alongside Sequoia Capital, Slow Ventures, Coatue, ...
- Name
- Nick Schrock
- Handle
- @schrockn
Nov 8, 2021
New in Dagster 0.13.0: Logging Improvements!
Logging without context, instance-wide handlers, capturing python logs, and more! Learn about the improvements we've ...
- Name
- Owen Kephart
- Handle
Oct 28, 2021
Dagster 0.13.0: A New Foundation
We’re proud to announce 0.13.0 of Dagster. We’ve made dramatic improvements to our core APIs, completely revamped our ...
- Name
- Nick Schrock
- Handle
- @schrockn
Aug 10, 2021
Community Memo: Moving Dagster's Core APIs Towards 1.0
As data practitioners increasingly depend on Dagster as a critical piece of their platforms, we believe it’s important ...
- Name
- Sandy Ryza
- Handle
- @s_ryz
Jul 19, 2021
Dagster 0.12.0: Into the Groove
In 0.12.0, we introduce pipeline failure sensors, solid-level retries, and more convenient testing APIs.
- Name
- Owen Kephart
- Handle
May 25, 2021
Community Memo: Approachability Improvements
In the last two months, we've made a set of changes aimed at making Dagster more approachable: to smooth out its ...
- Name
- Sandy Ryza
- Handle
- @s_ryz
May 18, 2021
Incrementally Adopting Dagster at Mapbox
At Mapbox, we've adopted Dagster without breaking compatibility with our legacy Airflow systems -- and with huge gains ...
- Name
- Ben Pleasanton
- Handle
May 13, 2021
Moving past Airflow: Why Dagster is the next-generation data orchestrator
Our most requested piece of content is a comparison between Dagster and Airflow. Here we detail the differences between ...
- Name
- Nick Schrock
- Handle
- @schrockn
Apr 1, 2021
Dagster 0.11.0: Lucky Star
In 0.11.0, we introduce dynamic orchestration, a new backfill UI, and support for tracking asset lineage.
Mar 15, 2021
Building shared spaces for data teams at Drizly
Dagster lets a small data infrastructure team efficiently ship a data platform that supports users with different ...
- Name
- Dennis Hume
- Handle
Jan 19, 2021
Dagster 0.10.0: The Edge of Glory
In 0.10.0, we introduce unique event-based scheduling capabilities, hardened deployments on Kubernetes, and new ...
- Name
- Nick Schrock
- Handle
- @schrockn
- Name
- Max Gasner
- Handle
- @gasnerpants
Dec 9, 2020
Good Data at Good Eggs: Using Dagster to manage the data platform
Running pipelines is only part of the operational burden of running a data platform. We also need to manage the ...
- Name
- David Wallace
- Handle
- @davidjwallace
Nov 5, 2020
Good Data at Good Eggs: Data observability with the asset catalog
What we’re aiming for with Dagster is a completely horizontal view of our data assets. Our analysts will be able to ...
- Name
- David Wallace
- Handle
- @davidjwallace
Oct 29, 2020
Dagster and dbt: Better Together
People sometimes ask us — should I use Dagster, or should I use dbt? We view Dagster and dbt as complementary ...
- Name
- AJ Nadel
- Handle
- @AJ_Nadel
- Name
- Bob Chen
- Handle
- @bobchen168
Oct 1, 2020
Good Data at Good Eggs: Correctness and reliability for data infrastructure
Dagster’s support for custom data types helped us achieve better correctness and reliability in our data ingest ...
- Name
- David Wallace
- Handle
- @davidjwallace
Oct 1, 2020
Good Data at Good Eggs: Part 1 of 4
Adopting Dagster was a catalyst for the transformation of our data platform team. We hope our experience is encouraging ...
- Name
- David Wallace
- Handle
- @davidjwallace
Sep 16, 2020
Testing and Deploying PySpark Jobs with Dagster
Spark has a beautiful API — so why is developing with it such a pain?
- Name
- Sandy Ryza
- Handle
- @s_ryz
Sep 15, 2020
Community Memo: September 2020 Update
Our monthly community meeting featured a retrospective of our 0.9.0 release, a preview of our 0.10.0 roadmap, and ...
Sep 10, 2020
Great Expectations for Dagster
We’re thrilled to announce a new integration between Dagster and a fellow open-source project, Great Expectations (GE).
- Name
- Leor Fishman
- Handle
- @fishmanl
Aug 11, 2020
Dagster: The Data Orchestrator
Dagster is a new type of workflow engine: a data orchestrator. Moving beyond just managing the ordering and physical ...
- Name
- Nick Schrock
- Handle
- @schrockn
- Name
- Max Gasner
- Handle
- @gasnerpants
Feb 26, 2020
Dagster 0.7.0: Waiting To Exhale
With 0.7.0 we set out improve the Dagster experience with large, production-scale pipelines, deployable to Kubernetes.
Oct 10, 2019
Dagster 0.6.0: Impossible Princess
With 0.6.0, Dagster comes “batteries-included” — but still with pluggable options — for everything you need to execute, ...
Jul 8, 2019
Introducing Dagster
Today the team at Elementl is proud to announce an early release of Dagster, an open-source library for building ...