v0.3.0

Storage

Manage object storage across multiple cloud providers.

Overview

FacilFlow provides a unified interface for object storage operations across MinIO, AWS S3, Azure Blob Storage, and Google Cloud Storage. Navigate to Operate > Storage.

Supported Providers

Provider Use Case
MinIO Self-hosted S3-compatible storage for on-premise deployments
AWS S3 Cloud-native storage on AWS
Azure Blob Cloud storage on Microsoft Azure
Google Cloud Storage Cloud storage on GCP

Configuring a Provider

  1. Click Add Storage Provider
  2. Select the provider type
  3. Enter credentials (access key, secret key, endpoint for MinIO; IAM role or keys for cloud)
  4. Test the connection
  5. Save

Bucket Management

Action Description
Create Create a new bucket with a name and optional region
List View all buckets with size and object count
Delete Remove an empty bucket
Configure Set bucket policies, versioning, lifecycle rules

Object Operations

Action Description
Upload Upload files via drag-and-drop or file picker
Download Download objects to your local machine
Delete Remove objects from a bucket
Preview Preview supported file types (CSV, JSON, images)
Copy Copy objects between buckets or providers

Presigned URLs

Generate time-limited URLs for secure file sharing:

  1. Select an object
  2. Click Generate URL
  3. Set expiration (1 hour to 7 days)
  4. Copy the URL — anyone with it can download until it expires

Presigned URLs work with all providers and require no authentication to access.

Pipeline Integration

Storage buckets can be used as pipeline sinks:

  • Add an S3 Sink node to your pipeline
  • Select the storage provider and bucket
  • Configure file format (Parquet, CSV, JSON) and partitioning
  • Data writes to the configured bucket as the pipeline runs
esc