Data Orchestration in an Increasingly Complex Data Ecosystem | Dagster Blog

September 10, 20231 minute read

Data Orchestration in an Increasingly Complex Data Ecosystem

Nick Schrock
Name
Nick Schrock
Handle
@schrockn

Data systems are inherently complex and often require integration of multiple technologies. Orchestrators are centralized utilities that control the execution and sequencing of interdependent operations. This offers a single location for managing visibility and error handling so that data platform engineers can manage complexity. In this episode Nick Schrock, creator of Dagster, shares his perspective on the state of data orchestration technology and its application to help inform its implementation in your environment.

Nick talks about the multi-faceted nature of data in an organization, and how that influences the capabilities and interfaces needed in an orchestration engine.


The Dagster Labs logo

We're always happy to hear your feedback, so please reach out to us! If you have any questions, ask them in the Dagster community Slack (join here!) or start a Github discussion. If you run into any bugs, let us know with a Github issue. And if you're interested in working with us, check out our open roles!

Follow us:


Read more filed under
Blog post category for Podcast. Podcast