Dagster Integration:
Tap into Fivetran sources from within your pipelines
Orchestrate Fivetran connectors and schedule syncs with upstream or downstream dependencies.
About this integration
With the Dagster-Fivetran integration you can orchestrate ingestion steps as part of a larger pipeline. Programatically interface with the Fivetran REST API to launch syncs and monitor their progress. Tap into software-defined assets and build a set of assets straight off a Fivetran ingestion.
Installation
pip install dagster-fivetran
Example
from dagster import EnvVar
from dagster_fivetran import FivetranResource, load_assets_from_fivetran_instance
import os
fivetran_instance = FivetranResource(
api_key="some_key",
api_secret=EnvVar("FIVETRAN_SECRET"),
)
fivetran_assets = load_assets_from_fivetran_instance(fivetran_instance)
About Fivetran
Fivetran ingests data from SaaS applications, databases, and servers. The data is stored and typically used for analytics.