Build Python Transforms

Python Transforms provide the flexibility and power of Python for complex data transformations, custom business logic, and advanced analytics. They're perfect when you need procedural programming, external libraries, or complex operations that go beyond SQL capabilities.

Before you begin

• Ensure you have an Ascend Project and Workspace
• Have Read Components or other data sources ready as inputs

Python Transform guides

🔄Simple Python Transforms

Full refresh transformations using Python and pandas. Perfect for complex logic, data cleaning, and custom transformations.

Start building

📈Incremental Python Transforms

Process only new or changed data with Python. Ideal for growing datasets with custom business logic and external API calls.

Start building

🧠Smart Python Transforms

Process data in chunks with intelligent partition detection. Perfect for large datasets requiring complex Python operations.

Start building

Next steps

After building your Python Transforms:

• 📤 Write transformed data to destinations
• 🧪 Add data tests to validate transformation logic
• 📋 Create Task Components for additional Python operations
• 🔄 Set up Automations to orchestrate your pipeline