Dagster Integration:
Dagster + Pandas

About this integration

Perform data validation, emit summary statistics, and enable reliable dataframe serialization/deserialization. The dagster_pandas library provides you with the utilities for implementing validation on pandas DataFrames. The Dagster type system generates documentation of your dataframe constraints and makes it accessible in the Dagit UI.

Installation

pip install dagster-pandas

About Pandas

Pandas is a very popular Python package that provides data structures designed to make working with “relational” or “labeled” data both easy and intuitive. Pandas aims to be the fundamental high-level building block for doing practical, real-world data analysis in Python.