Create Data Storage#

OSMO uses cloud storage buckets to power workflow execution and enable seamless data management:

  • Service Bucket: OSMO requires a dedicated bucket to function. This bucket stores workflow logs, manages intermediate data between tasks, and ensures smooth workflow execution.

  • Team Buckets: Development teams bring their own buckets to store, access, and manage their workflow data with complete isolation and control.

This separation ensures secure data isolation while giving teams the flexibility to manage their data independently.

Follow the below guides to create the required buckets:

AWS S3

Set up S3 buckets with IAM policies and user groups on AWS.

AWS S3
Azure Blob Storage

Configure Azure Blob Storage accounts, containers, and networking permissions.

Azure Blob Storage
Google Cloud Storage (GCS)

Create GCS buckets with IAM roles and access control lists on GCP.

Google Cloud Storage
Torch Object Storage (TOS)

Configure TOS buckets with IAM policies and user access.

Torch Object Storage

Once the desired buckets are created, follow instructions at Configure Data Storage to use them with OSMO.