Join us for a Dagster Deep Dive with Artefact - Dec 19

Back to integrations
Dagster + Prometheus

Dagster Integration:
Dagster + Prometheus

Integrate with Prometheus via the prometheus_client library.
Docs overviewAPI reference

About this integration

This integration allows you to push metrics to the Prometheus gateway from within a Dagster pipeline.

Installation

pip install dagster-prometheus

Example

#import dagster as dg
from dagster_prometheus import PrometheusResource


@dg.asset
def prometheus_metric(prometheus: PrometheusResource):
    prometheus.push_to_gateway(job="my_job_label")


defs = dg.Definitions(
    assets=[prometheus_metric],
    resources={
        "prometheus": PrometheusResource(gateway="http://pushgateway.example.org:9091")
    },
)

About Prometheus

Prometheus is an open-source systems monitoring and alerting toolkit. Originally built at SoundCloud, Prometheus joined the Cloud Native Computing Foundation in 2016 as the second hosted project, after Kubernetes.

Prometheus collects and stores metrics as time series data along with the timestamp at which it was recorded, alongside optional key-value pairs called labels.