Skip to main content
Version: 3.0.0

Tasks

Task Components integrate complex application and business logic into your data pipelines. Unlike Transform Components, Tasks aren't directly tied to the Data Plane, giving you more flexibility in how and where code executes.

Key Benefits​

  • Enhanced flexibility: Implement any business logic directly within Ascend, extending its data orchestration capabilities
  • Business logic integration: Embed business rules within flows to align data pipelines with organizational needs
  • Streamlined workflows: Handle complex logic within Ascend, reducing the need for external processing and manual intervention

Task Types​

info

For implementation details, see our how-to guides for Python Tasks and SQL Tasks.

  • Python Tasks: Execute Python code to perform data manipulation, apply conditional logic, make API calls, and leverage powerful Python libraries
  • SQL Tasks: Execute SQL queries to interact with data stores, perform complex operations, and integrate with database-specific features

How tasks work​

  • Integration with Flows: Tasks run in sequence with other components like data reads, writes, and transformations
  • Dependency management: Tasks specify their dependencies using decorators (Python) or config functions (SQL)
  • Execution context: Tasks execute within the Flow's runtime environment but can operate independently of the Data Plane

Use cases​

  • Metric computation: Calculate and log business metrics based on aggregated data
  • Data quality monitoring: Perform checks and raise alerts for data quality issues
  • External API integration: Connect with third-party services for data enrichment or notifications
  • Custom validation: Apply complex business rules that can't be expressed through standard transforms
  • Conditional workflows: Implement decision logic that affects downstream processing

Next Steps​

Last updated on