Build Python Read Components

Python Read Components provide the ultimate flexibility for data ingestion. They allow you to build custom data readers for APIs, web services, databases, and any other data source that Python can access. With Python, you can implement complex data extraction logic, handle authentication, and process data before it enters your pipeline.

Before you begin

• Ensure you have an Ascend Project and Workspace
• Basic Python programming knowledge
• Understanding of the data source you want to connect to

Python Read Component guides

🔄Simple Python Reads

Build basic Python Read Components for straightforward data extraction and processing.

Start building

📈Incremental Python Reads

Create incremental Read Components that track state and process only new or changed data.

Start building

🧠Smart Python Reads

Build intelligent Read Components that automatically detect changes and optimize processing.

Start building

Next steps

After building your Python Read Components:

• 🔄 Transform your data with SQL or Python
• 📤 Write data to destinations
• 🧪 Add data tests to validate data quality
• 🔄 Set up Automations to schedule regular data extraction