Skip to content

Pipelines

A pipeline runs steps in sequence with explicit boundaries.

Use it when you want composition without building a full orchestrator.

What pipelines are good for

  • Clean, linear flow: extract → verify → score
  • Explicit checkpoints between stages
  • Clear audit trail between stages

What pipelines are not

  • A graph engine
  • A scheduler
  • A replacement for your queue

Mental model

A pipeline is a list of stages. Each stage takes the current state and produces an output. The runner applies each output and moves on.

When to use what

Use caseUse
Linear flowPipeline
BranchingCommands
Audit + identityWorkflow
One-offBare step

If your flow is not linear, see Workflows first.

Design tips

  • Keep stages small and deterministic
  • Emit audit events per stage
  • Capture artifacts at stage boundaries

LLM context: llms.txt · llms-full.txt
Released under the Apache 2.0 License.