About this integration

This library provides an integration with both Snowflake and the Python Pandas data processing library.

Installation

pip install dagster-snowflake dagster-snowflake-pandas

Example

# Read the docs on IO Managers to learn more: https://docs.dagster.io/concepts/io-management/io-managers
from dagster_snowflake_pandas import snowflake_pandas_io_manager
from dagster import asset, with_resources
import pandas as pd


@asset
def my_table():
    return pd.DataFrame()

assets = with_resources([my_table], resource_defs={
    "io_manager": snowflake_pandas_io_manager.configured({
        "account": "snowflake_account",
        "user": "snowflake_user",
        "password": os.environ["SNOWFLAKE_PASSWORD"],
        "database": "snowflake_db",
        "warehouse": "snowflake_warehouse",
    }),
})

About Snowflake + Pandas

There is probably a great "Pandas love snow" joke to be made here. While we work on that, you can check out how to translate between slices of Snowflake tables and Pandas DataFrames.