S3 Connection

InlineS3Connection

info

InlineS3Connection is defined beneath the following ancestor nodes in the YAML structure:

Below are the properties for the InlineS3Connection. Each property links to the specific details section further down in this page.

Property	Default	Type	Required	Description
s3			Yes	The S3 connection options.

A connection to a data source/sink.

Property	Default	Type	Required	Description
connection		One of: S3Connection GcsConnection AbfsConnection LocalFileConnection SnowflakeConnection BigQueryConnection MSSQLConnection MySQLConnection OracleConnection PostgresConnection HttpConnection DuckDBConnection SFTPConnection DatabricksConnection	Yes	The connection to the data system.

Connection to a DuckDB database.

Property	Type	Required	Description
description	string	No	A brief description of what the model does.
metadata		No	Meta information of a resource. In most cases it doesn't affect the system behavior but may be helpful to analyze project resources.
name	string	Yes	The name of the model
duckdb		Yes	The DuckDB connection options.

DuckDB connection options.

Property	Type	Required	Description
max_query_length	integer	No	The maximum query length to allow.
max_concurrent_queries	integer	No	The maximum number of concurrent queries to allow.
max_combined_sql_statements	integer	No	The maximum number of combined SQL statements to allow.
path	string	No	The path to the DuckDB database file. Use ':memory:' for in-memory databases. This setting is ignored when ducklake configuration is present.
memory_limit	integer	No	The memory limit to use for the DuckDB connection.
ducklake		No	Configuration for using DuckLake with this DuckDB connection.
schema	string	No	The schema to use for the DuckDB connection. If left empty, the flow name will be used as the schema name at runtime
init_sql	string	No	SQL to run when the DuckLake connection is initialized.

DuckLake configuration options.

Property	Default	Type	Required	Description
metadata_connection_name		string	No	The name of the Ascend Connection to use for DuckLake metadata storage (Postgres connections only).
data_connection_name		string	No	The name of the Ascend Connection to use for DuckLake data storage (Local Files, GCS, S3, or ABFS connections supported).
metadata_connection		Any of: InlinePostgresConnection ASCEND_MANAGED	No	Inline metadata connection configuration (Postgres connections only).
data_connection		Any of: One of: InlineLocalFileConnection InlineS3Connection InlineGcsConnection InlineAbfsConnection ASCEND_MANAGED	No	Inline data connection configuration (Local Files, GCS, S3, or ABFS connections supported).
metadata_schema	default	string	No	The schema name within the Postgres database to use for DuckLake metadata storage. If left as the default value of 'default', the schema name will be replaced with the profile name at runtime.
data_path	ascendlake/data	string	No	Path within the data connection root where DuckLake data files will be stored.

Amazon S3 connection options.

Property	Default	Type	Required	Description
region		string	No	The AWS region to connect to.
root		string	Yes	the s3 URL for the root prefix.
aws_access_key_id		string	No	The access key ID to use for the S3 connection.
aws_secret_access_key		string	No	The secret access key to use for the S3 connection.
enable_default_credential_chain	False	boolean	No	If True, enables use of the default credential chain for the S3 connection if no other credentials are provided.