Tasks
Read, write, and transform
Understanding Tasks
Powerful abstractions that simplify development workflows
Pipelines represent discrete workflows that consist of a sequence of compute actions. Pipelines within Kaspian are represented as directed acyclic graphs (DAGs) that are executed at scheduled cadences. These DAGs are composed of Tasks, which are individual executions powered by separate code. The input and output of each of these tasks is associated with one or more Schemas, which describe how the data looks.