Dagster Integration:
Dagster SSH/SFTP library

About this integration

This integration provides a resource for SSH remote execution using Paramiko. It allows you to establish secure connections to networked resources and execute commands remotely. The integration also provides an SFTP client for secure file transfers between the local and remote systems.

Installation

pip install dagster-ssh

Example

import dagster as dg
from dagster_ssh import SSHResource


@dg.asset
def ssh_asset(ssh: SSHResource):
    ssh.sftp_get("/path/to/remote.csv", "path/to/local.csv")


defs = dg.Definitions(
    assets=[ssh_asset],
    resources={"ssh": SSHResource(remote_host="foo.com", key_file="path/to/id_rsa")},
)

About SSH SFTP

The SSH protocol allows for secure remote login with strong authentication to networked resources. It protects network connections with strong encryption. The Dagster library provides direct SSH and SFTP calls from within the execution of your pipelines.