Snowflake Connection

Snowflake data warehouse Connection.

Examples

snowflake_connection_basic.yaml

connection:
  snowflake:
    database: my_database
    account: your-snowflake-account
    user: your-username
    password: ${vaults.my_vault_name.your-password}

snowflake_connection_schema.yaml

connection:
  snowflake:
    database: my_database
    account: your-snowflake-account
    user: your-username
    password: ${vaults.my_vault_name.your-password}
    create_schema_if_not_exists: true

snowflake_connection_config.yaml

connection:
  snowflake:
    database: my_database
    account: your-snowflake-account
    user: your-username
    password: ${vaults.my_vault_name.your-password}
    warehouse: your-warehouse
    role: your-role
    max_concurrent_queries: 50

SnowflakeConnection

info

SnowflakeConnection is defined beneath the following ancestor nodes in the YAML structure:

• Connection

Below are the properties for the SnowflakeConnection. Each property links to the specific details section further down in this page.

Property	Default	Type	Required	Description
description		string	No	Brief description of what the model does.
metadata			No	Meta information of a resource. In most cases it doesn't affect the system behavior but may be helpful to analyze project resources.
name		string	Yes	The name of the model
snowflake			Yes	The Snowflake Connection options.

Property Details

Connection

Data source/sink Connection.

Property	Default	Type	Required	Description
connection		One of:   S3Connection   GcsConnection   AbfsConnection   LocalFileConnection   SnowflakeConnection   BigQueryConnection   MSSQLConnection   MySQLConnection   OracleConnection   PostgresConnection   HttpConnection   DuckDBConnection   SFTPConnection   DatabricksConnection	Yes	Data system Connection.

SnowflakeConnectionOptions

Snowflake Connection options.

Property	Default	Type	Required	Description
max_query_length		integer	No	Maximum combined query length permitted during query batching.
max_concurrent_queries		integer	No	Maximum number of concurrent queries permitted.
max_combined_sql_statements		integer	No	Maximum number of combined SQL statements permitted during query batching.
account		string	Yes	Snowflake account.
user		string	Yes	Snowflake user.
password		string	No	Snowflake user password.
private_key		string	No	Private key file for Snowflake.
database		string	Yes	Snowflake database.
schema	PUBLIC	string	No	Snowflake schema.
warehouse		string	No	Snowflake warehouse.
role		string	No	Snowflake role.
create_schema_if_not_exists		boolean	No	Boolean flag indicating whether to create the schema if it does not exist.
max_dml_per_table	20	integer	No	Snowflake has a built-in limit of 20 DML statements that target the same table concurrently, including COPY, INSERT, MERGE, UPDATE, and DELETE.

ResourceMetadata

Meta information of a resource. In most cases, it doesn't affect the system behavior but may be helpful to analyze Project resources.

Property	Default	Type	Required	Description
source			No	The origin or source information for the resource.
source_event_uuid		string	No	Event UUID associated with creation of this resource.

ResourceLocation

The origin or source information for the resource.

Property	Default	Type	Required	Description
path		string	Yes	Path within repository files where the resource is defined.
first_line_number		integer	No	First line number within path file where the resource is defined.