About this integration
This library provides an integration with both Snowflake and the Python Pandas data processing library.
Installation
pip install dagster-snowflake dagster-snowflake-pandas
Example
# Read the docs on IO Managers to learn more: https://docs.dagster.io/concepts/io-management/io-managers
from dagster_snowflake_pandas import snowflake_pandas_io_manager
from dagster import asset, with_resources
import pandas as pd
@asset
def my_table():
return pd.DataFrame()
assets = with_resources([my_table], resource_defs={
"io_manager": snowflake_pandas_io_manager.configured({
"account": "snowflake_account",
"user": "snowflake_user",
"password": os.environ["SNOWFLAKE_PASSWORD"],
"database": "snowflake_db",
"warehouse": "snowflake_warehouse",
}),
})
About Snowflake + Pandas
There is probably a great "Pandas love snow" joke to be made here. While we work on that, you can check out how to translate between slices of Snowflake tables and Pandas DataFrames.