Build Read Components
Read Components are the starting points of your data pipelines. They connect Ascend to various data sources and bring data into your Data Plane for processing. This section provides step-by-step guides for building Read Components for different types of data sources.
Before you beginโ
- Ensure you have an Ascend Project and Workspace
- Set up the appropriate Connection for your data source
Read Component guidesโ
๐๏ธ Database Sources
Read data from relational databases like MySQL, PostgreSQL, Oracle, and SQL Server with support for incremental loading
โ๏ธ File systems
Ingest data from cloud storage services like AWS S3, Google Cloud Storage, and Azure Blob Storage
๐ Python Read Components
Build custom Read Components using Python for APIs, web services, and complex data sources
๐ Aliases
Reference existing tables in your Data Plane without duplication
๐ Connection-based Reads
Understand how Read Components work with Connections
Next stepsโ
After building your Read Components:
- ๐ Transform your data with SQL or Python
- ๐ค Write data to destinations
- ๐งช Add data tests to validate quality
- ๐ Create Task Components for custom processing