Dagster 1.4: Material Girl
We are pleased to announce that Dagster 1.4.0 — “Material Girl” — is now available on Dagster Cloud and in Open Source. Full details on the release can be found in the release notes, but here are the highlights:
The headlining act on this release is the dagster-dbt enhancements. While Dagster already provided a dagster-dbt integration (as well as a dbt Cloud integration), we have gathered input from Dagster users who rely heavily on dbt and introduced brand new capabilities:
- A new @dbt-assets decorator allows much more control over how Dagster runs your dbt project.
- A new scaffolding command line interface makes it easy to create files and directories for a Dagster project that wraps an existing dbt project.
- Improved APIs for defining asset dependencies between upstream dbt assets and downstream non-dbt assets. It is now much easier to specify dependencies between dbt models and upstream non-dbt assets by specifying Dagster asset keys in the dbt metadata for dbt sources.
Evolving asset materialization, improving the UI, and more
We continue to evolve asset materialization, giving you more fine-grained control and observability over when, why, and how your computations run. These include auto-materialization history, auto-materialization performance, asset backfill cancellation, and a new group-level asset status UI.
We have also focused on improving some of the framework ergonomics, making it more logical and accessible. Improvements here include:
- Deprecation of
non_argument_depsin favor of a new
depsparameter (makes it clear that this is a first-class way of defining dependencies, makes code more concise, while still accepting previous parameters)
- Renaming Dagit to Dagster UI (reducing the number of terms that new users need to learn)
- Auto-populating the launchpad with default field values (reducing cognitive load).
We have moved some features out of the “experimental” stage:
Finally, we have a new UI layout change that is flagged as
experimental and open to your feedback in the GitHub discussion found here. The new layout renders the graph horizontally left-to-right instead of vertically. You can try the new horizontal asset graph layout by enabling the
Experimental horizontal asset DAGs feature flag in your user settings. Give it a try, and let us know what you think.
We would like to thank all of the contributors to the 1.4 Dagster Core release.
We're always happy to hear your feedback, so please reach out to us! If you have any questions, ask them in the Dagster community Slack (join here!) or start a Github discussion. If you run into any bugs, let us know with a Github issue. And if you're interested in working with us, check out our open roles!