Skip to main content
Version: 3.0.0

Instance Store

The Instance Store is the centralized storage space that holds all metadata associated with your Instance. It's required for Instance setup and serves as the source of truth for all Flow Run data in your pipelines.

The Instance Store manages operational data, identity details, Vault secrets, configurations, states, and project-specific metadata, ensuring reliable maintenance of your Ascend Instance. instance store

Key features​

The Instance Store holds critical metadata that drives the behavior of an Ascend Instance, including:

  • Execution logs: Records of data processing tasks, including timestamps, status messages, and error details. These logs are essential for debugging and performance monitoring.

  • Performance metrics: Data points tracking execution time, CPU and memory usage, and data throughput. These metrics help optimize data workflow performance.

  • Audit trails: Records of actions within the data plane, such as data access, modifications, and user activities. Audit trails provide a history of actions for security and compliance purposes.

  • Data lineage: Information detailing the origin and transformation of data through the pipeline. Data lineage helps track data flow, transformations, and ensures data integrity.

  • Configuration metadata: Configuration details of data processing Components like Read Connectors, Transforms, and Write Connectors, including parameters and settings.

  • Operational metadata: Information about the operational context of tasks, such as data plane configuration, compute resources, and storage locations. This metadata aids in infrastructure management.

  • Persistence and reliability: Reliable storage that retains your metadata, ensuring consistent access to all operational data. This supports the continuity and stability of the Ascend platform as configurations evolve.

Last updated on