# Announcing AI Driven Data Engineering

> Learn how to build production-ready ELT pipelines using AI coding agents and Dagster. The AI-Driven Data Engineering course teaches practical workflows for AI-assisted data engineering.

Source: https://dagster.io/blog/announcing-ai-driven-data-engineering
Published: 2026-03-05

AI coding agents are changing how data engineers work.

Over the past year we have been thinking carefully about how to make Dagster the best framework to use alongside an AI agent. Today, we are introducing a new addition to Dagster University: AI-Driven Data Engineering.

[Jump to the AI-Driven Data Engineering course page](https://courses.dagster.io/courses/ai-driven-data-engineering)

## Learn

Teams at many of the most exciting companies in the world use Dagster to build sophisticated data platforms. Our goal has always been to make those capabilities accessible to every user.

AI-Driven Data Engineering is an eight-lesson course that takes you from a blank directory to a production-ready ELT pipeline built entirely from prompts.

Along the way you will learn how to:

- Choose the right AI tools
- Guide an agent toward Dagster best practices
- Develop judgment about when to trust generated output and when to verify it

Each lesson builds on the last. By the end, you will have a complete project ready to deploy.

![](https://dagster.io/blog-assets/fa114d28f5d7fbce5711.gif)

## Who This Course Is For

This course is designed for two groups of engineers.

**1. Engineers who want to learn Dagster or become Dagster power users**

If you are new to Dagster, this course shows you how to build a real project from scratch using modern workflows. If you already use Dagster, it will help you learn patterns that experienced teams rely on to move faster and build reliable pipelines.

**2. Engineers exploring agentic coding workflows**

Many teams are still figuring out how to best use AI to help them build effectively.

This course focuses on the practical side of that shift: how to structure a project so an agent can contribute reliably, how to guide an agent toward good architecture, and how to manage sessions and context when working on complex systems.

In other words, it teaches both Dagster best practices and how to get the most out of AI-assisted development.

## AI-Driven Development with Dagster

To support this new way of working, we have invested in tooling that makes AI-driven development reliable and practical:

- An opinionated CLI (`dg`) that gives agents deterministic, validated actions
- Maintained agent skills that keep output aligned with Dagster best practices
- Components that provide predictable structure for common integrations

Historically, becoming a Dagster power user required internalizing a set of patterns and best practices. That created a real gap between getting started and moving quickly with confidence. But AI agents change that.

With the right tooling and structure, an agent can help guide users toward good patterns from the start. The goal is not to replace expertise, but to make that expertise more accessible.

Our aim is simple: help every data engineer become a power user of Dagster.

![](https://dagster.io/blog-assets/1bb5cac4e0fbb0d4f10d.png)

## Enroll Today

Like all Dagster University courses, AI-Driven Data Engineering is free and open to everyone. Sign up for Dagster University to get started. Once enrolled, you can track your progress and complete the course at your own pace.

[Jump to the AI-Driven Data Engineering course page](https://courses.dagster.io/courses/ai-driven-data-engineering)