Skip to main content

GCS Connection

Connection to a bucket in Google Cloud Storage.

Examples​

connection:
gcs:
root: "gs://my-bucket/"

GcsConnection​

info

GcsConnection is defined beneath the following ancestor nodes in the YAML structure:

Below are the properties for the GcsConnection. Each property links to the specific details section further down in this page.

PropertyDefaultTypeRequiredDescription
descriptionstring
NoA brief description of what the model does.
metadataNoMeta information of a resource. In most cases it doesn't affect the system behavior but may be helpful to analyze project resources.
namestringYesThe name of the model
gcsYesThe GCS Connection options.

Property Details​

Connection​

Data source/sink Connection.

PropertyDefaultTypeRequiredDescription
connectionOne of:
  S3Connection
  GcsConnection
  AbfsConnection
  LocalFileConnection
  SnowflakeConnection
  BigQueryConnection
  MSSQLConnection
  MySQLConnection
  OracleConnection
  PostgresConnection
  HttpConnection
  DuckDBConnection
  SFTPConnection
  DatabricksConnection
YesData system Connection.

GcsConnectionOptions​

Google Cloud Storage Connection options.

PropertyDefaultTypeRequiredDescription
rootstringYesGCS URL for the root prefix.
keystring
NoGCP service account credentials to use for the GCS Connection.

ResourceMetadata​

Meta information of a resource. In most cases, it doesn't affect the system behavior but may be helpful to analyze Project resources.

PropertyDefaultTypeRequiredDescription
sourceNoThe origin or source information for the resource.
source_event_uuidstring
NoUUID of the event that is associated with creation of this resource.

ResourceLocation​

The origin or source information for the resource.

PropertyDefaultTypeRequiredDescription
pathstringYesPath within repository files where the resource is defined.
first_line_numberinteger
NoFirst line number within path file where the resource is defined.