Dagster is now part of PrefectRead the announcement

Connect to everything
in your data ecosystem

Dagster integrates with every major tool in the modern data and AI stack—so your orchestrator isn’t the blocker, it’s the bridge.

Explore Integrations

Explore Integrations

Explore docs, guides, and examples for Dagster’s integrations—spanning orchestration, ingestion, storage, transformation, and beyond.

Airbyte

Orchestrate Airbyte connections and schedule syncs alongside upstream or downstream dependencies.

ETL / Reverse ETL

Anthropic

Integrate Anthropic's Claude AI models into your Dagster pipelines for advanced conversational AI capabilities.

Other

Apache Airflow

Accelerate the migration of Airflow DAGs to Dagster assets with opinionated tooling.

Other

AWS Athena

This integration allows you to connect to AWS Athena and analyze data in Amazon S3 using standard SQL within your Dagster pipelines.

Storage

AWS CloudWatch

This integration allows you to send Dagster logs to AWS CloudWatch, enabling centralized logging and monitoring of your Dagster jobs.

Logging & Monitoring

AWS ECR

This integration allows you to connect to AWS Elastic Container Registry (ECR), enabling you to manage your container images more effectively in your Dagster pipelines.

Other

AWS EMR

The AWS EMR integration allows you to seamlessly integrate AWS EMR into your Dagster pipelines for petabyte-scale data processing using open-source tools like Apache Spark, Hive, Presto, and more.

Compute

AWS Glue

The AWS Glue integration enables you to initiate AWS Glue jobs directly from Dagster, seamlessly pass parameters to your code, and stream logs and structured messages back into Dagster.

Compute

AWS Lambda

Using the AWS Lambda integration with Dagster, you can leverage serverless functions to execute external code in your pipelines.

Compute

AWS Redshift

Using this integration, you can seamlessly integrate AWS Redshift into your Dagster workflows, leveraging Redshift’s data warehousing capabilities for your data pipelines.

Storage

AWS S3

The AWS S3 integration allows data engineers to easily read and write objects to the durable AWS S3 storage, enabling engineers to have a resilient storage layer when constructing their pipelines.

Storage

AWS Secrets Manager

This integration allows you to manage, retrieve, and rotate credentials, API keys, and other secrets using AWS Secrets Manager.

Other

AWS Systems Parameter Store

The excerpt for the document is: "The Dagster AWS Systems Manager (SSM) Parameter Store integration allows you to manage and retrieve parameters stored in AWS SSM Parameter Store directly within your Dagster pipelines.

Other

Azure Data Lake Storage Gen 2 (ADLS2)

Get utilities for ADLS2 and Blob Storage.

Storage

Bash / Shell

Execute a Bash/shell command, directly or as a read from a script file.

Compute

Clickhouse

An integration with Clickhouse. Read and write natively to Clickhouse from Software Defined Assets.

Storage

Cube

Push changes from upstream data sources to Cube's semantic layer.

Other

Databricks

The Databricks integration enables you to initiate Databricks jobs directly from Dagster, seamlessly pass parameters to your code, and stream logs and structured messages back into Dagster.

Compute

Datadog

Publish metrics to Datadog from within Dagster ops and entralize your monitoring metrics.

Logging & Monitoring

dbt Cloud

Run dbt Cloud™ jobs as part of your data pipeline.

ETL / Reverse ETL

dbt™

Put your dbt transformations to work, directly from within Dagster.

ETL / Reverse ETL

dlt

Easily ingest and replicate data between systems with dlt through Dagster.

ETL / Reverse ETL

Docker

Run runs external processes in docker containers directly from Dagster.

Compute

DuckDB

Read and write natively to DuckDB from Software Defined Assets.

Storage

Fivetran

Orchestrate Fivetran connectors and schedule syncs with upstream or downstream dependencies.

ETL / Reverse ETL

GCP BigQuery

Integrate with GCP BigQuery.

Storage

GCP GCS

Integrate with GCP GCS.

Storage

Github

Integrate with GitHub Apps and automate operations within your github repositories.

Other

Great Expectations

Yield an expectation and its output with all relevant metadata.

Other

Hashicorp Vault

Centrally manage credentials and certificates, then use them in your pipelines.

Other

Hightouch

Trigger syncs and monitor them until they complete.

ETL / Reverse ETL

Jupyter

Dagstermill eliminates the tedious "productionization" of Jupyter notebooks.

Compute

Kubernetes

Launch Kubernetes pods and execute external code directly from Dagster.

Compute

Looker

The Looker integration allows you to monitor your Looker instance as assets in Dagster, along with other data assets.

Business Intelligence

Meltano

Tap into open source configurable ETL+ and the Singer integration library.

ETL / Reverse ETL

Microsoft SharePoint

Connect Dagster with Microsoft SharePoint document libraries using the Graph API. Enable automated file operations, folder management, and data extraction from SharePoint.

Storage

Microsoft Teams

Keep your team up to speed with Teams messages.

Alerting

MLflow

Streamline the process of productionizing, maintaining and monitoring machine learning models.

Modal

Run serverless Python functions at scale with Modal directly from your Dagster pipelines.

Compute

OpenAI

Integrate OpenAI calls into your Dagster pipelines, without breaking the bank.

Other

Open Metadata

Configure and schedule Dagster metadata and profiler workflows from the OpenMetadata UI.

Metadata & Data Quality

Pandas

Implement validation on pandas DataFrames.

Metadata & Data Quality

Pandera

Generate Dagster Types from Pandera dataframe schemas.

Metadata & Data Quality

Polars

Use Polars eager or lazy DataFrames as inputs and outputs in your Dagster assets and ops.

Metadata & Data Quality

Power BI

The Power BI integration allows you to monitor your Power BI workspace as assets in Dagster, along with other data assets.

Business Intelligence

Prometheus

Integrate with Prometheus via the prometheus_client library.

Logging & Monitoring

Ray

Scale your Python workloads with Ray's distributed computing framework directly from Dagster.

Compute

Salesforce

Integrate Salesforce CRM data into your Dagster pipelines. Query records, perform bulk operations, and sync customer data with support for multiple authentication methods.

Other

Sigma

The Sigma integration allows you to monitor your Sigma organization as assets in Dagster, along with other data assets.

Business Intelligence

Slack

Up your notification game and keep stakeholders in the loop.

Alerting

Sling

Extract and load data from popular data sources to destinations with Sling through Dagster.

ETL / Reverse ETL

SLURM

Bridge high-performance computing with modern data orchestration. Run Dagster assets seamlessly across laptops, CI pipelines, and supercomputers with full observability.

Compute

Snowflake

An integration with the Snowflake AI Data Cloud. Read and write natively to Snowflake from Software Defined Assets.

Storage

Spark

Configure and run Spark jobs.

Compute

SSH/SFTP

Establish encrypted connections to networked resources.

Other

Tableau

The Tableau integration allows you to monitor your Tableau workspace as assets in Dagster, along with other data assets.

Business Intelligence

Weights & Biases

Orchestrate your MLOps pipelines and maintain ML assets.

Other

Start Your Data Journey Today

Unlock the power of data orchestration with our demo or explore the open-source version.

Start free