Tables

Overview

Tables are brought into a workflow via its Data sources, and are then created as the output of various transforms and notebooks in the workflow. Tables often serve to materialize intermediary results, sanity check an output, as well as final data derivative representing the culmination of your analysis pipeline.

Workflow tables follow the behavior and functionality of tables across Redivis.

Usage in workflows

All table nodes have one upstream parent, either a data source, a transform, or a notebook.

On each table, you can create any number of transforms or notebooks, which then reference that table as their "source". Tables can also be joined into transforms and notebooks that do not have the table as their primary source.

Table node states

As you work in a workflow, nodes colors and symbols will change on the tree view to help you keep track of your work progress.

State	Display	Details
Empty	White background	A table node will be empty when it contains no data because the upstream node has not been executed.
Executed	Grey background	A table node will be grey when it has data that aligns with the contents of its upstream node.
Stale	Yellow background	A table node will be stale when an upstream change has been made. This means the content of the node does not match the content of the node above it.
Sampled	Black circle with 1% icon	Only relevant to dataset tables: This means that you are using a 1% sample of the table. When a dataset has a sample, it will automatically default to it when added to a workflow. You can change this to the full sample and back at any time in the dataset node.
Incomplete access	All black background, or dashed borders	You don't have full access the table. Click on the Incomplete access button in the top bar to begin applying for access to the relevant datasets.
Archived	archived pill	The table has been archived, and only its metadata is available. You'll need to re-run the upstream node in order to unarchive the table.