Build Python Read Components
Python Read Components provide the ultimate flexibility for data ingestion. They allow you to build custom data readers for APIs, web services, databases, and any other data source that Python can access. With Python, you can implement complex data extraction logic, handle authentication, and process data before it enters your pipeline.
Before you begin
- Ensure you have an Ascend Project and Workspace
- Basic Python programming knowledge
- Understanding of the data source you want to connect to
Python Read Component guides
🔄 Simple Python Reads
Build basic Python Read Components for straightforward data extraction and processing
📈 Incremental Python Reads
Create incremental readers that track state and process only new or changed data
🧠 Smart Python Reads
Build intelligent readers that automatically detect changes and optimize processing
Next steps
After building your Python Read Components:
- 🔄 Transform your data with SQL or Python
- 📤 Write data to destinations
- 🧪 Add data tests to validate data quality
- 🔄 Set up Automations to schedule regular data extraction