Snowflake Connection
Connection to a Snowflake data warehouse.
Examples
- snowflake_connection_basic.yaml
- snowflake_connection_schema.yaml
- snowflake_connection_config.yaml
connection:
snowflake:
account: your-snowflake-account
user: your-username
password: ${secret.my_vault_name.your-password}
connection:
snowflake:
account: your-snowflake-account
user: your-username
password: ${secret.my_vault_name.your-password}
create_schema_if_not_exists: true
connection:
snowflake:
account: your-snowflake-account
user: your-username
password: ${secret.my_vault_name.your-password}
warehouse: your-warehouse
role: your-role
max_concurrent_queries: 50
SnowflakeConnection
info
SnowflakeConnection
is defined beneath the following ancestor nodes in the YAML structure:
Below are the properties for the SnowflakeConnection
. Each property links to the specific details section further down in this page.
Property | Default | Type | Required | Description |
---|---|---|---|---|
name | string | No | The name of the model | |
description | string | No | A brief description of what the model does. | |
metadata | ResourceMetadata | No | Meta information of a resource. In most cases it doesn't affect the system behavior but may be helpful to analyze project resources. | |
snowflake | SnowflakeConnectionOptions | Yes | The Snowflake connection options. |
Property Details
Connection
A connection to a data source/sink.
Property | Default | Type | Required | Description |
---|---|---|---|---|
connection | One of: S3Connection GcsConnection AbfsConnection LocalFileConnection SnowflakeConnection BigQueryConnection MSSQLConnection MySQLConnection OracleConnection PostgresConnection HttpConnection DuckDBConnection CustomPythonConnection SynapseConnection | Yes | The connection to the data system. |
SnowflakeConnectionOptions
Snowflake connection options.
Property | Default | Type | Required | Description |
---|---|---|---|---|
max_query_length | integer | No | The maximum query length to allow. | |
max_concurrent_queries | integer | No | The maximum number of concurrent queries to allow. | |
max_combined_sql_statements | integer | No | The maximum number of combined SQL statements to allow. | |
account | string | Yes | The Snowflake account to connect to. | |
user | string | Yes | The Snowflake user to connect as. | |
password | string | No | The Snowflake password to use for the connection. | |
private_key | string | No | The private key file to use for the Snowflake connection. | |
database | string | No | The Snowflake database to connect to. | |
schema | PUBLIC | string | No | The Snowflake schema to use. |
warehouse | string | No | The Snowflake warehouse to use. | |
role | string | No | The Snowflake role to use. | |
create_schema_if_not_exists | boolean | No | A boolean flag indicating whether to create the schema if it does not exist. | |
max_dml_per_table | 20 | integer | No | Snowflake has a built-in limit of 20 DML statements that target the same table concurrently, including COPY, INSERT, MERGE, UPDATE, and DELETE. |
ResourceMetadata
Meta information of a resource. In most cases it doesn't affect the system behavior but may be helpful to analyze project resources.
Property | Default | Type | Required | Description |
---|---|---|---|---|
source | ResourceLocation | No | The origin or source information for the resource. | |
source_event_uuid | string | No | UUID of the event that is associated with creation of this resource. |
ResourceLocation
The origin or source information for the resource.
Property | Default | Type | Required | Description |
---|---|---|---|---|
path | string | Yes | Path within repository files where the resource is defined. | |
first_line_number | integer | No | First line number within path file where the resource is defined. |