About this integration

This integration provides a resource for SSH remote execution using Paramiko.

Installation

pip install dagster-ssh

Example

# Read the docs on Resources to learn more: https://docs.dagster.io/deployment/resources
from dagster import asset, with_resources
from dagster_ssh import ssh_resource

@asset(required_resource_keys={'ssh'})
def my_asset(context):
    context.resources.ssh.sftp_get("/path/to/remote.csv", "path/to/local.csv")

assets = with_resources([my_asset], resource_defs={
    'ssh': ssh_resource.configured({
        'remote_host': 'foo.com',
        'key_file': 'path/to/id_rsa',
    })
})

About SSH SFTP

The SSH protocol allows for secure remote login with strong authentication to networked resources. It protects network connections with strong encryption. The Dagster library provides direct SSH and SFTP calls from within the execution of your pipelines.