Local File Connection
InlineLocalFileConnection
info
InlineLocalFileConnection is defined beneath the following ancestor nodes in the YAML structure:
Below are the properties for the InlineLocalFileConnection. Each property links to the specific details section further down in this page.
| Property | Default | Type | Required | Description |
|---|---|---|---|---|
| local_file | Yes | The local file connection options. |
Property Details
Connection
A connection to a data source/sink.
| Property | Default | Type | Required | Description |
|---|---|---|---|---|
| connection | One of: S3Connection GcsConnection AbfsConnection LocalFileConnection SnowflakeConnection BigQueryConnection MSSQLConnection MySQLConnection OracleConnection PostgresConnection HttpConnection DuckDBConnection SFTPConnection DatabricksConnection | Yes | The connection to the data system. |
DuckDBConnection
Connection to a DuckDB database.
| Property | Default | Type | Required | Description |
|---|---|---|---|---|
| description | string | No | A brief description of what the model does. | |
| metadata | No | Meta information of a resource. In most cases it doesn't affect the system behavior but may be helpful to analyze project resources. | ||
| name | string | Yes | The name of the model | |
| duckdb | Yes | The DuckDB connection options. |
DuckDBConnectionOptions
DuckDB connection options.
| Property | Default | Type | Required | Description |
|---|---|---|---|---|
| max_query_length | integer | No | The maximum query length to allow. | |
| max_concurrent_queries | integer | No | The maximum number of concurrent queries to allow. | |
| max_combined_sql_statements | integer | No | The maximum number of combined SQL statements to allow. | |
| path | string | No | The path to the DuckDB database file. Use ':memory:' for in-memory databases. This setting is ignored when ducklake configuration is present. | |
| memory_limit | integer | No | The memory limit to use for the DuckDB connection. | |
| ducklake | No | Configuration for using DuckLake with this DuckDB connection. | ||
| schema | string | No | The schema to use for the DuckDB connection. If left empty, the flow name will be used as the schema name at runtime |
DuckLakeOptions
DuckLake configuration options.
| Property | Default | Type | Required | Description |
|---|---|---|---|---|
| metadata_connection_name | string | No | The name of the Ascend Connection to use for DuckLake metadata storage (Postgres connections only). | |
| data_connection_name | string | No | The name of the Ascend Connection to use for DuckLake data storage (Local Files, GCS, S3, or ABFS connections supported). | |
| metadata_connection | Any of: InlinePostgresConnection ASCEND_MANAGED | No | Inline metadata connection configuration (Postgres connections only). | |
| data_connection | Any of: One of: InlineLocalFileConnection InlineS3Connection InlineGcsConnection InlineAbfsConnection ASCEND_MANAGED | No | Inline data connection configuration (Local Files, GCS, S3, or ABFS connections supported). | |
| metadata_schema | default | string | No | The schema name within the Postgres database to use for DuckLake metadata storage. If left as the default value of 'default', the schema name will be replaced with the profile name at runtime. |
| data_path | ascendlake/data | string | No | Path within the data connection root where DuckLake data files will be stored. |
LocalFileConnectionOptions
Local file connection options.
| Property | Default | Type | Required | Description |
|---|---|---|---|---|
| root | string | Yes | The root directory for the local file connection. |