Dagster is excited to announce the launch of ETL with Dagster, a comprehensive seven-lesson course. This free course guides you through practical ETL implementation and architectural considerations, from single-file ingestion to full-scale database replication
We recently held a webinar with dlt discussing how to use Dagster for effectively ETL processes. This is such a popular use case, we are happy to announce a new addition to Dagster University: ETL with Dagster!
Jump to the ETL with Dagster course page ↗
Learn
When building a data platform, consolidating your various data sources is often one of the first steps. This is why Extract, Transform, Load (ETL) remains one of the most common use cases for Dagster.
ETL with Dagster is a seven-lesson course, with each lesson focused on a different aspect of ETL. Ingestion spans a wide range of topics, and this course is designed to guide you through both the practical steps and architectural considerations, from single-file ingestion to full-scale database replication. You'll learn how to incorporate key Dagster features to improve the maintainability of your ETL pipelines, and explore libraries and frameworks that pair especially well with Dagster to streamline ETL development.
ETL in Dagster
At Dagster, we practice what we preach. You can explore how we manage ETL for dozens of data sources in our own open data platform. Chances are, you're looking to build something similar.
This module covers:
- The fundamentals of ETL across various domains.
- Common ingestion patterns for static files, APIs, and database replication.
- Embedded ETL for quick-starting pipelines in Dagster.
- How Dagster components can simplify setting up integrations.
We believe ETL is foundational but it shouldn’t feel like a chore. By the end of this course, you’ll understand how to handle a wide range of integration patterns and discover that many can be implemented in just a few lines of code.
Enroll Today
Like all Dagster University courses, ETL with Dagster is free and available to everyone. Simply sign up at Dagster University to get started. Once enrolled, you can track your progress and learn at your own pace.
Jump to the ETL with Dagster course page ↗
We're always happy to hear your feedback, so please reach out to us! If you have any questions, ask them in the Dagster community Slack (join here!) or start a Github discussion. If you run into any bugs, let us know with a Github issue. And if you're interested in working with us, check out our open roles!
