Write to BigQuery

This guide shows you how to create a BigQuery Write Component.

Prerequisites

• BigQuery Connection with write permissions
• An Ascend Flow with a Component that contains data

Create a new Write Component

Begin from your workspace Super Graph view. Follow these steps to create your Write Component:

Using the Component Form

1. Double-click the Flow where you want to create your component
2. Right-click on any Component
3. Hover over Create Downstream -> Write, and select your target Connection
4. Complete the form with these details:
   • Select your Flow
   • Enter a descriptive Component Name like write_mysql

Using the Files Panel

1. Open the Files panel in the top left corner
2. Navigate to and select your desired Flow
3. Right-click on the components directory and choose New file
4. Name your file with a descriptive name like write_mysql.yaml and press enter

Configure your BigQuery Write Component

Follow these steps to set up your BigQuery Write Component:

1. Configure your Connection
   • Enter your BigQuery Connection name in the connection field
2. Specify a data source
   • Set input to the Component that contains your source data
3. Define the write target
   • Configure the bigquery write connector options
   • Specify your target table name, schema, and other required properties
4. Select a write strategy

   Choose one of these strategies based on your use case:

   Strategy	Description	Best For
   full	Replaces entire target during each Flow Run	Reference tables, complete data refreshes
   partitioned	Updates only modified partitions	Time-series data, regional datasets, date-partitioned data

5. Set strategy-specific options
   • For full: use drop_and_recreate mode
   • For partitioned: use append, insert_overwrite, or sync mode

See the Write Components reference guide for all available options.

Examples

Choose the write strategy that best fits your use case:

Full write strategy

This example shows a BigQuery Write Component that uses a full write strategy with drop_and_recreate mode. This strategy replaces all data in the target table during each Flow Run, ensuring a complete refresh.

write_bigquery_full.yaml

component:
  write:
    connection: write_bigquery
    input:
      name: my_component
      flow: my_flow
    bigquery:
      table:
        name: my_table
        dataset: my_output_dataset
    strategy:
      full:
        mode: drop_and_recreate

Partitioned write strategy

This example shows a BigQuery Write Component that uses a partitioned write strategy with sync mode. This strategy only updates modified partitions while preserving existing partitions, which is more efficient for large datasets.

write_bigquery_partitioned.yaml

component:
  write:
    connection: write_bigquery
    input:
      name: my_component
      flow: my_flow
    strategy:
      partitioned:
        mode: sync
    bigquery:
      table:
        name: my_partitioned_table
        dataset: my_output_dataset

🎉 Congratulations! You successfully created a BigQuery Write Component in Ascend.