About this integration
This library provides an integration with both Snowflake and the Python Pandas data processing library.
Installation
pip install dagster-snowflake dagster-snowflake-pandas
Example
# Read the docs on IO Managers to learn more: https://docs.dagster.io/concepts/io-management/io-managers
from dagster_snowflake_pandas import snowflake_pandas_io_manager
from dagster import Definitions, EnvVar, asset
import pandas as pd
@asset
def my_table():
return pd.DataFrame()
defs = Definitions(
assets=[my_table],
resources={
"io_manager": SnowflakePandasIOManager(
account="snowflake_account",
user="snowflake_user",
password=EnvVar("SNOWFLAKE_PASSWORD"),
database="snowflake_db",
warehouse="snowflake_warehouse",
),
}
)
About Snowflake + Pandas
There is probably a great "Pandas love snow" joke to be made here. While we work on that, you can check out how to translate between slices of Snowflake tables and Pandas DataFrames.