Community / Partner Supported
Orchestrate Noteable notebooks
If orchestrating notebooks is on your roadmap, the Noteable team has made this much easier.
About this integration
From the get-go Dagster provided support for notebooks thanks to the Dagstermill library. The Dagstermill package makes it straightforward to run notebooks using the Dagster tools, integrating them into data pipelines with heterogeneous computation and storage: for instance, Spark jobs, SQL statements run against a data warehouse, or arbitrary Python code.
The Noteable integrations provides a set of capabilities over and above Dagster's preexisting Dagstermill library, including:
- comment and collaborate via notebook links
- enjoy improved visualizations
- tap into native data connectors
- comment on notebooks and build in notifications
- fix issues on live jobs
- add automatic notebook versioning tied to the original notebook file
Installation
pip install papermill_origami
Example
from papermill_origami.noteable_dagstermill import (
define_noteable_dagster_asset,
)
noteable_asset = define_noteable_dagster_asset(
name="my_noteable_asset",
notebook_id="my_notebook_id",
)
About Noteable
Noteable is a collaborative data notebook platform for data-driven teams.
Community / Partner integration:
This integration was built and is maintained by a community user or a technology partner from outside of Dagster Labs.