Read from Object Store Sources

Object Store Read Components connect to cloud storage services and object stores to ingest data into your pipelines. They support various file formats and offer features like partitioned reading, metadata extraction, and flexible file filtering to efficiently bring data from storage into your Data Plane.

Before you begin

• Ensure you have an Ascend Project and Workspace
• Set up the appropriate object store Connection for your storage provider

Object store Read guides

📦Amazon S3

Read data from S3 buckets with support for various file formats and partitioned data.

Start building

☁️Google Cloud Storage

Ingest data from GCS buckets with flexible file filtering and format detection.

Start building

🔷Azure Blob Storage

Connect to Azure Blob containers and read data with automatic parsing.

Start building

📁Local File

Read data from local files for development and testing.

Start building

📊Metadata

Extract and work with file metadata for advanced data processing.

Start building

Next steps

After setting up object store reads:

• 🔄 Transform your data with SQL or Python
• 📤 Write data to destinations
• 🧪 Add data tests to validate data quality
• 🔄 Set up Automations to process files automatically