About this integration

This library provides an integration with both Snowflake and the Python Pandas data processing library.

Installation

pip install dagster-snowflake dagster-snowflake-pandas

Example

# Read the docs on IO Managers to learn more: https://docs.dagster.io/concepts/io-management/io-managers
from dagster_snowflake_pandas import snowflake_pandas_io_manager
from dagster import Definitions, EnvVar, asset
import pandas as pd


@asset
def my_table():
    return pd.DataFrame()

defs = Definitions(
    assets=[my_table],
    resources={
        "io_manager": SnowflakePandasIOManager(
            account="snowflake_account",
            user="snowflake_user",
            password=EnvVar("SNOWFLAKE_PASSWORD"),
            database="snowflake_db",
            warehouse="snowflake_warehouse",
        ),
    }
)

About Snowflake + Pandas

There is probably a great "Pandas love snow" joke to be made here. While we work on that, you can check out how to translate between slices of Snowflake tables and Pandas DataFrames.