Archival & deletion

Archival

Table auto-archival

If you haven't interacted with tables in your workflow for a while, these tables may become archived, which will temporarily limit your ability to view cells and query data in that table. This is done to prevent runaway storage costs, while leveraging the built-in reproducibility of workflows to allow you to unarchive the table and pick up where you last left off.

The archival algorithm prioritizes tables that are large, quick to regenerate, and intermediary (not at the bottom of the tree). It currently does not archive tables less than 1GB; in many cases you may never interact with archived tables.

If a table is archived, you can still see the name, row count, and variable names/types. To access variable summary statistics, view cells, or run transforms or notebooks downstream of an archived table, you'll have to reconstitute the table by re-running upstream nodes.

Archival on dataset deletion

When a dataset or version is deleted, all derivative tables associated with the corresponding dataset or version will be immediately marked as archived throughout your workflows. Because the source data is now deleted, the path towards unarchival is now more complex. In the case of version deletion, you may be able to change the version on the corresponding data source and re-run the downstream nodes. In the case of a deleted dataset, you'll need to replace the dataset with a dataset that has not been deleted in order to re-run the downstream nodes.

Archival on workflow deletion

When a workflow is deleted, all of its tables will immediately become archived, and will show up as archived if the workflow is subsequently undeleted.

Workflow deletion

Workflow owners can delete a workflow by navigating to the workflow and clicking the three-dot More menu at the top right, and selecting "Delete workflow". When a workflow is deleted, all of its tables are immediately archived, and it will no longer show up in search results.

Workflows can currently only be undeleted by intervention from Redivis support, though we are working to bring this functionality in-app. In the interim, please contact [email protected] if you would like to undelete an accidentally deleted workflow.