Read from Object Store Sources

Object Store Read Components connect to cloud storage services and object stores to ingest data into your pipelines. They support various file formats and offer features like partitioned reading, metadata extraction, and flexible file filtering to efficiently bring data from storage into your Data Plane.

Before you begin

• Ensure you have an Ascend Project and Workspace
• Set up the appropriate object store Connection for your storage provider

Table of Contents (ToC)

• Read from ABFS
• Read from GCS
• Read from S3
• Read from local files
• Expose original filename and timestamp metadata in Read Components