Dagster Events

We showcase how Dagster and Modal combine to orchestrate scalable workloads with an intuitive developer experience to build scalable, robust pipelines.

The Modern Data Stack offers countless tools but often creates hard-to-manage pipelines. This talk shows how to transform disjointed tools into a unified, observable data platform with default high-quality data.

The Dagster Labs and SDF teams show how the combined strengths of the two solutions can enhance your developer experience, streamline your data pipelines, reduce costs, and enhance data quality and reliability.

Colton Padden walks us through why—and how to—implement data quality checks in the orchestrator. We discuss Implementing data quality checks and building orchestration logic around the outcomes of quality checks.

Watch the Dagster+ launch event where we demonstrate major new product capabilities.

Effective collaboration around data requires the right tooling for balancing local autonomy and unified orchestration. Tim walks us through how to set Dagster up to support a ‘Data Mesh’ and other approaches to empowering local data teams.

By embracing partitioning you can speed up execution and greatly reduce the cost of running pipelines. Gain control over backfills, and observe your data assets at a higher level of granularity.

Colton Padden guides us through Dagster's configuration and resource systems, which allow you to develop locally and ship confidently.

Pedram Navid shares insights into how to use Dagster's flexible scheduling options to automate and optimize your data platform.

Sandy Ryza and Pete Hunt discuss how to build a high-performance data platform that delivers the assets all stakeholders can trust.

Pedram Navid, Head of Data Engineering and DevRel, walks us through the newly released Embedded ELT feature in Dagster, which provides support for lightweight data movement libraries.

The advent of the Modern Data Stack revolutionized the domain of data engineering. But over time it drifted from its original premise. It became fragmented, overcomplicated, and expensive to run.