Build a templatized data pipeline

This guide demonstrates how to create reusable data transformations using Ascend's Simple Application. The Simple Application is a pre-built Ascend solution that lets you define parameterized SQL transforms with Jinja templating for flexible, maintainable data pipelines.

Want to learn more about Ascend-native Applications? Check out this concept guide.

Simple Application setup

The Simple Application uses SQL templates with Jinja to create parameterized components. In this guide, we'll create a straightforward filtering application:

1. Create a template directory - Add a folder structure in your project to organize your SQL templates:

   my_project/
   ├── templates/
   │   └── flows/
   │       └── basic_filter/
   │           └── filter.sql.jinja

2. Create a simple SQL template - Add a .sql.jinja file with placeholders for parameters:

   filter.sql.jinja

   SELECT *
   FROM {{ ref(input_table) }}
   WHERE {{ filter_column }} > {{ filter_value }}
   LIMIT {{ row_limit }}

3. Configure the Application - Create a YAML file that references the SQL template and defines parameter values:

   basic_filter.yaml

   component:
     application:
       application_id: simple  # The Simple Application
       config:
         template_path: templates/flows/basic_filter  # Directory with your templates
         parameters:
           input_table: YOUR_INPUT_TABLE
           filter_column: YOUR_COLUMN_NAME
           filter_value: 100
           row_limit: 1000

When this configuration is processed, Ascend will generate a Transform component that filters your data based on these parameters.

🎉 Congratulations – You've successfully created a Simple Application!