Archival & deletion

Table archival

Table auto-archival

If you haven't interacted with tables in your workflow for a while, these tables may become archived, which will temporarily limit your ability to view cells and query data in that table. This is done to prevent runaway storage costs, while leveraging the built-in reproducibility of workflows to allow you to unarchive a table and pick up where you last left off.

The archival algorithm prioritizes tables that are large and quick to recompute. It currently does not archive tables less than 1GB; in many cases you may never interact with archived tables.

If a table is archived, you can still see the name, row count, variables, and any cached variable statistics. To access view cells, or run transforms or notebooks downstream of an archived table, you'll have to reconstitute the table by re-running upstream nodes.

Table archival on upstream dataset events

When a dataset or version is deleted, or marked as archived, all derivative tables associated with the corresponding dataset or version will be immediately marked as archived throughout your workflows.

Depending on the state of the dataset, the path towards unarchival is now more complex. In the case of version deletion, you can change the version on the corresponding data source and re-run downstream nodes. In the case of an archived dataset, you'll need to reach out to the data owner to request that the dataset be unarchived. In the case of a deleted dataset, you'll need to replace the dataset with a dataset that has not been deleted in order to re-run the downstream nodes.

Table archival on workflow deletion

When a workflow is deleted, all of its tables will immediately become archived, and will show up as archived if the workflow is subsequently undeleted or referenced in another workflow.

Workflow deletion

Workflow owners can delete a workflow by navigating to the workflow and clicking the three-dot More menu at the top right, and selecting "Delete workflow". When a workflow is deleted, all of its tables are immediately archived, and it will no longer show up in search results.

Workflows can currently only be undeleted by intervention from Redivis support, though we are working to bring this functionality in-app. In the interim, please contact [email protected] if you would like to undelete an accidentally deleted workflow.