Scheduler
Schedule pipeline executions with cron expressions or event-based triggers.
Overview
The Scheduler automates pipeline runs on a recurring basis or in response to events. Navigate to Operate > Scheduler to manage jobs.
Cron Scheduling
Creating a Cron Job
- Click Create Schedule
- Select the pipeline to run
- Define the cron expression using the visual builder or manual input
- Set timezone
- Save
Cron Expression Builder
The visual builder lets you configure schedules without memorizing cron syntax:
- Select frequency: minutely, hourly, daily, weekly, monthly
- Pick specific times, days, or intervals
- Preview next 5 execution times before saving
Cron Syntax Reference
┌───────────── minute (0-59)
│ ┌───────────── hour (0-23)
│ │ ┌───────────── day of month (1-31)
│ │ │ ┌───────────── month (1-12)
│ │ │ │ ┌───────────── day of week (0-6, Sun=0)
│ │ │ │ │
* * * * *
| Expression | Schedule |
|---|---|
*/5 * * * * |
Every 5 minutes |
0 * * * * |
Every hour |
0 6 * * * |
Daily at 6:00 AM |
0 0 * * 1 |
Every Monday at midnight |
0 0 1 * * |
First of every month |
Event-Based Triggers
Trigger pipeline runs in response to events:
| Trigger | Description |
|---|---|
| Pipeline completion | Run pipeline B when pipeline A finishes |
| Data arrival | Run when new data lands in a source |
| Webhook | Run when an external webhook is received |
| Manual | Trigger via UI button or API call |
Creating an Event Trigger
- Click Create Schedule and select Event-based
- Choose the trigger type
- Configure trigger parameters
- Select the pipeline to execute
- Save
Execution History
View past and upcoming executions:
| Column | Description |
|---|---|
| Pipeline | Which pipeline ran |
| Trigger | Cron or event that triggered it |
| Started | Execution start time |
| Duration | How long it ran |
| Status | Success, failed, running, queued |
Click a row to see execution logs.
Job Queue
When multiple schedules fire simultaneously, jobs enter a queue:
- Jobs execute in priority order
- View queued jobs and their position
- Cancel queued jobs before they start