Build SQL Transform Components
SQL Transform Components are perfect for set-based operations, aggregations, filtering, and joins. They leverage the power of SQL to process relational data efficiently within your Data Plane. SQL transforms are ideal when you need to perform standard data transformations using familiar SQL syntax.
Before you begin
- Ensure you have an Ascend Project and Workspace
- Have Read Components or other data sources ready as inputs
- Basic SQL knowledge
SQL Transform guides
🔄 Simple SQL Transforms
Full refresh transformations that reprocess all data on each run. Perfect for smaller datasets or complete data refresh scenarios.
📈 Incremental SQL Transforms
Process only new or changed data since the last run. Ideal for growing datasets to optimize performance and reduce costs.
🧠 Smart SQL Transforms
Process data in chunks based on partition keys. Perfect for large datasets with automatic change detection and optimization.
Next steps
After building your SQL Transform Components:
- 📤 Write transformed data to destinations
- 🧪 Add data tests to validate transformation logic
- 📋 Create Task Components for additional SQL operations
- 🔄 Set up Automations to orchestrate your pipeline