Create an Azure Blob Storage Read Component

This guide walks you through creating a Read Component that ingests data from Azure Blob Storage.

Prerequisites

• Ascend Flow
• Azure Blob Storage Connection

Create a new Component

Begin from your workspace Super Graph view. Follow these steps to create your component:

Using the Component Form

1. Double-click the Flow where you want to create your component
2. Right-click anywhere in the Flow Graph
3. Hover over Create Component, then over Read in the expanded menu, and click From Scratch
4. Complete the form with these details:
   • Select your Flow
   • Enter a descriptive Component Name like read_sales
   • Select YAML as your file type

Using the Files Panel

1. Open the files panel in the top left corner
2. Navigate to and select your desired Flow
3. Right-click on the components directory and choose New file
4. Name your file with a descriptive name like read_sales.yaml and press enter

Create your Azure Blob Storage Read Component

Structure your Azure Blob Storage Read Component following this pattern:

1. Reference your Azure Blob Storage connection: Specify which Azure connection to read from
2. Add the abfs key: Configure the specific Azure Blob Storage settings
   • path: Specify the path to read from (container/directory/file)
3. Add parser configuration: Specify how to parse the files (if applicable)
4. Additional options: Include any Azure-specific settings

Example

read_abfss.yaml

component:
  read:
    connection: read_abfss_lake
    abfs:
      path: my_file.csv

This example shows a simple configuration to:

• Read a specific file (my_file.csv) from your Azure Blob Storage container
• Use the connection named read_abfss_lake that you've previously set up

For a complete list of configuration options and advanced settings, see this reference guide.

🎉 Congratulations! You successfully created an Azure Blob Storage Read Component in Ascend.