Overview

Workflows are used to analyze data on Redivis at any scale. They allow you to organize your analysis into discrete steps, where you can easily validate your results and develop well-documented, reproducible analyses.

Workflows are owned by users or organizations, and can be shared with other users and organizations.

The workflow page

The workflow page consists of a top title bar, a left pane, and a right pane.

The left pane displays the workflow tree, allowing you to visualize how data is moving through the workflow and its nodes. Switching between nodes is the main way of navigating around a workflow.

The right pane shows the contents of the currently selected node. If no node is selected, this panel will display the workflow's overview and metadata. You can select the workflow title or empty space in the workflow tree to return to the workflow overview at any time.

The title bar provides an entry point to common actions, broken into two sections. The left section contains actions that are global to the workflow while the right section contains actions relevant to the currently selected node, such as running a transform.

The workflow tree

The workflow tree is represented visually in the left pane of the workflow. This tree is comprised of a collection of nodes, with each node having various inputs and outputs, such that the output, or result, of one node can serve as the input of another.

Data in the tree flows from the top to bottom. Circular relationships are not allowed. Formally, this is known as a "Directed Acyclic Graph" (DAG).

Selecting a node within the tree will display that node's contents within the right pane of the workflow, while highlighting the ancestors and descendants of that node on the tree.

You can right-click on any node for a list of other options. Similarly you may select the node then the three-dot "More" menu at the top-right.

Workflow nodes

The workflow tree is made up of the following node types:

Data sources represent datasets or workflows that have been added to a workflow, and are the mechanism for bringing data into a workflow.

Tables are either tables associated with a data source, or the resulting output table of a transform or notebook.

Transforms are queries that are used to reshape and combine data, always creating a single table as an output.

Notebooks are flexible, interactive programming environments, which can optionally produce a table as an output.