Skip to main content
Version: 3.0.0

Synapse Connection

SynapseConnection

info

SynapseConnection is defined beneath the following ancestor nodes in the YAML structure:

Below are the properties for the SynapseConnection. Each property links to the specific details section further down in this page.

PropertyDefaultTypeRequiredDescription
namestring
NoThe name of the model
descriptionstring
NoA brief description of what the model does.
metadataResourceMetadata
NoMeta information of a resource. In most cases it doesn't affect the system behavior but may be helpful to analyze project resources.
synapseSynapseConnectionOptionsYesThe Synapse connection options.

Property Details

Connection

A connection to a data source/sink.

PropertyDefaultTypeRequiredDescription
connectionOne of:
  S3Connection
  GcsConnection
  AbfsConnection
  LocalFileConnection
  SnowflakeConnection
  BigQueryConnection
  MSSQLConnection
  MySQLConnection
  OracleConnection
  PostgresConnection
  HttpConnection
  DuckDBConnection
  CustomPythonConnection
  SynapseConnection
YesThe connection to the data system.

SynapseConnectionOptions

PropertyDefaultTypeRequiredDescription
max_query_lengthinteger
NoThe maximum query length to allow.
max_concurrent_queriesinteger
NoThe maximum number of concurrent queries to allow.
max_combined_sql_statementsinteger
NoThe maximum number of combined SQL statements to allow.
hoststringYesThe MSSQL server host to connect to.
userstringYesThe MSSQL Server user to connect as.
passwordstringYesThe MSSQL Server password to use for the connection.
databasestring
NoThe MSSQL Server database to connect to.
schemadbostringNoThe MSSQL schema to use.
portinteger
NoThe MS SQL Server port to connect to.
driverstring ("ODBC Driver 18 for SQL Server", "FreeTDS")YesThe driver to use for the MSSQL connection.
stagingSynapseExternalDataSourceYesThe external data source to use for staging data for synapse to load from.
create_schema_if_not_existsboolean
NoA boolean flag indicating whether to create the schema if it does not exist.
table_indexstring ("heap", "clustered_columnstore")
NoThe type of index to use for the table.
distributionstring ("ROUND_ROBIN", "REPLICATE")
NoThe type of distribution to use for the table.

SynapseExternalDataSource

PropertyDefaultTypeRequiredDescription
namestringYesThe unique name of the external data source.
abfsAbfsConnectionOptionsYesThe ABFS connection to use for the external data source.

AbfsConnectionOptions

Azure Blob File System connection options.

PropertyDefaultTypeRequiredDescription
accountstring
NoThe Azure Blob File System account name to connect to.
rootstringYesThe abfs[s] URL for the root prefix.
shared_keystring
NoThe Azure Blob File System shared key to use for the ABFS connection.
service_principalAbfsServicePrincipal
NoThe Azure Blob File System service principal in JSON to use for the ABFS connection. The JSON should include a key named 'client_id' for the client ID, a key named 'client_secret' for the client secret, and a key named 'tenant_id' for the tenant ID.

AbfsServicePrincipal

PropertyDefaultTypeRequiredDescription
client_idstringYesThe client ID for the service principal.
client_secretstringYesThe client secret for the service principal.
tenant_idstringYesThe tenant ID for the service principal.

ResourceMetadata

Meta information of a resource. In most cases it doesn't affect the system behavior but may be helpful to analyze project resources.

PropertyDefaultTypeRequiredDescription
sourceResourceLocation
NoThe origin or source information for the resource.
source_event_uuidstring
NoUUID of the event that is associated with creation of this resource.

ResourceLocation

The origin or source information for the resource.

PropertyDefaultTypeRequiredDescription
pathstringYesPath within repository files where the resource is defined.
first_line_numberinteger
NoFirst line number within path file where the resource is defined.