Snowflake + Pandas | Dagster Integrations
Back to integrations
Snowflake + Pandas

Snowflake + Pandas

Translate between slices of Snowflake tables and Pandas DataFrames.

About this integration

This library provides an integration with both Snowflake and the Python Pandas data processing library.

Installation

pip install dagster-snowflake dagster-snowflake-pandas

Example

# Read the docs on IO Managers to learn more: https://docs.dagster.io/concepts/io-management/io-managers
from dagster_snowflake_pandas import snowflake_pandas_io_manager
from dagster import Definitions, EnvVar, asset
import pandas as pd


@asset
def my_table():
    return pd.DataFrame()

defs = Definitions(
    assets=[my_table],
    resources={
        "io_manager": SnowflakePandasIOManager(
            account="snowflake_account",
            user="snowflake_user",
            password=EnvVar("SNOWFLAKE_PASSWORD"),
            database="snowflake_db",
            warehouse="snowflake_warehouse",
        ),
    }
)

About Snowflake + Pandas

There is probably a great "Pandas love snow" joke to be made here. While we work on that, you can check out how to translate between slices of Snowflake tables and Pandas DataFrames.