The Pipeline module allows splitting processes in steps and then running them via an orchestrator service. The main goal of this module is to make it easier to execute long processes without running out of memory or timing-out.

Architecture

Pipelines are defined as plugins of type @PipelinePipeline(). A pipeline consists in a number of pipeline steps. Each step is a plugin of type @PipelineStep().