Create and manage data pipelines with the visual builder.
Overview
The Pipeline Builder uses a drag-and-drop interface to create data flows:
- Source Nodes: Data inputs (PI, OPC-UA, Modbus, MQTT)
- Processor Nodes: Data transformations (filter, aggregate, transform)
- Sink Nodes: Data outputs (InfluxDB, Kafka, S3)
Creating a Pipeline
- Navigate to Pipelines in the sidebar
- Click Create Pipeline
- Drag nodes from the palette onto the canvas
- Connect nodes by dragging from output to input handles
- Configure each node by clicking on it
- Click Save Pipeline
Node Types
Source Nodes
| Type | Description |
|---|
| AVEVA PI | Connect to PI Server via PI Web API |
| OPC-UA | OPC Unified Architecture protocol |
| Modbus | Modbus TCP/RTU devices |
| MQTT | MQTT broker subscription |
Processor Nodes
| Type | Description |
|---|
| Filter | Filter data based on conditions |
| Transform | Apply transformations (unit conversion, scaling) |
| Aggregate | Roll up data (avg, min, max, sum) |
Sink Nodes
| Type | Description |
|---|
| InfluxDB | Write to InfluxDB time-series database |
| Kafka | Publish to Kafka topics |
| S3 | Store in S3-compatible object storage |
Pipeline Operations
- Start: Begin data collection
- Stop: Pause data collection
- Edit: Modify pipeline configuration
- Delete: Remove pipeline