Ascend-native Modules

Ascend provides pre-defined patterns that let you implement common data processing tasks like building templatized data pipelines.

What are Ascend-native Modules?

Ascend-native Modules are a specialized type of Module designed to streamline repetitive data engineering tasks. While Custom Modules require you to write your own implementation, Ascend-native Modules use Ascend-provided code to automatically generate Module Components based on your configuration parameters.

How Ascend-native Modules work

Ascend-native Modules operate by:

1. Leveraging pre-built Python definitions (such as the Blueprint Module)
2. Accepting parameters through YAML configuration of SQL or Python templates
3. Automatically generating appropriate Module Components based on your specifications
4. Orchestrating these Components into an integrated, functional Flow Graph

Blueprint Module

The Blueprint Module takes a path in your repository to a folder with Ascend Component templates and generates functional Components based on the templates found in that path.

Ascend-native Modules vs. Custom Modules

Choose Ascend-native Modules when:

• You need to implement standard patterns with minimal setup time
• Your requirements align with built-in Ascend-native Modules
• You prefer configuration-based solutions over custom code development

Choose Custom Modules when:

• You need specialized logic that goes beyond what Ascend-native Modules provide
• You require precise control over Component generation and relationships
• You want to implement proprietary business logic or unique data transformations

Ready to use an Ascend-native Module? Check out our guide for a step-by-step walkthrough.