v0.3.0

Scheduler

Schedule pipeline executions with cron expressions or event-based triggers.

Overview

The Scheduler automates pipeline runs on a recurring basis or in response to events. Navigate to Operate > Scheduler to manage jobs.

Cron Scheduling

Creating a Cron Job

  1. Click Create Schedule
  2. Select the pipeline to run
  3. Define the cron expression using the visual builder or manual input
  4. Set timezone
  5. Save

Cron Expression Builder

The visual builder lets you configure schedules without memorizing cron syntax:

  • Select frequency: minutely, hourly, daily, weekly, monthly
  • Pick specific times, days, or intervals
  • Preview next 5 execution times before saving

Cron Syntax Reference

┌───────────── minute (0-59)
│ ┌───────────── hour (0-23)
│ │ ┌───────────── day of month (1-31)
│ │ │ ┌───────────── month (1-12)
│ │ │ │ ┌───────────── day of week (0-6, Sun=0)
│ │ │ │ │
* * * * *
Expression Schedule
*/5 * * * * Every 5 minutes
0 * * * * Every hour
0 6 * * * Daily at 6:00 AM
0 0 * * 1 Every Monday at midnight
0 0 1 * * First of every month

Event-Based Triggers

Trigger pipeline runs in response to events:

Trigger Description
Pipeline completion Run pipeline B when pipeline A finishes
Data arrival Run when new data lands in a source
Webhook Run when an external webhook is received
Manual Trigger via UI button or API call

Creating an Event Trigger

  1. Click Create Schedule and select Event-based
  2. Choose the trigger type
  3. Configure trigger parameters
  4. Select the pipeline to execute
  5. Save

Execution History

View past and upcoming executions:

Column Description
Pipeline Which pipeline ran
Trigger Cron or event that triggered it
Started Execution start time
Duration How long it ran
Status Success, failed, running, queued

Click a row to see execution logs.

Job Queue

When multiple schedules fire simultaneously, jobs enter a queue:

  • Jobs execute in priority order
  • View queued jobs and their position
  • Cancel queued jobs before they start
esc