The advent of the Modern Data Stack revolutionized the domain of data engineering. But over time it drifted from its original premise. It became fragmented, overcomplicated, and expensive to run.
During Launch Week, we shared our vision of how to escape this Modern Data Trap, and get back to the initial intent: a developer experience that is unified, streamlined, collaborative, and where you are in control of costs.
We then unveiled a first set of new capabilities to help data engineering teams move towards this empowered, more productive state.
Discover the new features,
capabilities and resources:
Dagster Pipes and External Assets.
Two new features expand the span of control of the orchestration layer to new languages and new compute environments. Foster cross-team collaboration without refactoring existing work.
Asset Checks
Introduce Data Quality steps to Dagster. Define and enforce data quality rules that target Dagster assets, then build logic around the results.
Dagster Insights
Gives you enhanced operational observability and insights into how your pipeline design drives cloud compute cost. Optimize your runs and get more out of your budget.
Dagster University
Is a brand new introduction course to Dagster fundamentals. Get your team up and running quickly with this brand-new resource.
Embedded ELT
Brings straightforward data movement capability straight into the orchestrator, oftentimes avoiding the need for a heavyweight 3rd party tool.
The advent of the Modern Data Stack revolutionized the domain of data engineering. But over time it drifted from its original premise. It became fragmented, overcomplicated, and expensive to run.
During Launch Week, we shared our vision of how to escape this Modern Data Trap, and get back to the initial intent: a developer experience that is unified, streamlined, collaborative, and where you are in control of costs.
We then unveiled a first set of new capabilities to help data engineering teams move towards this empowered, more productive state.
Discover the new features,
capabilities and resources:
Dagster Pipes and External Assets.
Two new features expand the span of control of the orchestration layer to new languages and new compute environments. Foster cross-team collaboration without refactoring existing work.
Asset Checks
Introduce Data Quality steps to Dagster. Define and enforce data quality rules that target Dagster assets, then build logic around the results.
Dagster Insights
Gives you enhanced operational observability and insights into how your pipeline design drives cloud compute cost. Optimize your runs and get more out of your budget.
Dagster University
Is a brand new introduction course to Dagster fundamentals. Get your team up and running quickly with this brand-new resource.
Embedded ELT
Brings straightforward data movement capability straight into the orchestrator, oftentimes avoiding the need for a heavyweight 3rd party tool.
