Skip to main content

SFTP Connection

SFTP server Connection.

SFTPConnection​

info

SFTPConnection is defined beneath the following ancestor nodes in the YAML structure:

Below are the properties for the SFTPConnection. Each property links to the specific details section further down in this page.

PropertyDefaultTypeRequiredDescription
descriptionstring
NoA brief description of what the model does.
metadataNoMeta information of a resource. In most cases it doesn't affect the system behavior but may be helpful to analyze project resources.
namestringYesThe name of the model
sftpYes

Property Details​

Connection​

Data source/sink Connection.

PropertyDefaultTypeRequiredDescription
connectionOne of:
  S3Connection
  GcsConnection
  AbfsConnection
  LocalFileConnection
  SnowflakeConnection
  BigQueryConnection
  MSSQLConnection
  MySQLConnection
  OracleConnection
  PostgresConnection
  HttpConnection
  DuckDBConnection
  SFTPConnection
  DatabricksConnection
YesData system Connection.

SFTPConnectionOptions​

SFTP Connection options.

PropertyDefaultTypeRequiredDescription
hoststringYesSFTP server hostname.
port22integerNoSFTP server port.
usernamestringYesUsername for SFTP authentication.
passwordstring
NoPassword for SFTP authentication.
private_keystring
NoPrivate key string for SFTP authentication.
private_key_passphrasestring
NoPassphrase for the private key, if it's encrypted.
root/stringNoRoot directory on the SFTP server to use as the base path.
max_concurrent_connectionsinteger
NoMaximum number of concurrent connections to the SFTP server. If not specified, the default behavior is to use a concurrency value that maximizes download throughput based on the number of CPU cores allocated to the Pod.

ResourceMetadata​

Meta information of a resource. In most cases, it doesn't affect the system behavior but may be helpful to analyze Project resources.

PropertyDefaultTypeRequiredDescription
sourceNoThe origin or source information for the resource.
source_event_uuidstring
NoUUID of the event that is associated with creation of this resource.

ResourceLocation​

The origin or source information for the resource.

PropertyDefaultTypeRequiredDescription
pathstringYesPath within repository files where the resource is defined.
first_line_numberinteger
NoFirst line number within path file where the resource is defined.