API DocumentationRedivis Home

Quotas and limits

Redivis has limits in place to protect systems and guide correct usage. Some of these limits are more flexible than others, please contact us if your specific use case is affected by these limits.

Datasets

  • Max versions: 1,000

  • Max tables: 1,000

  • Max unstructured files: 100M

  • Max unstructured file size (per-file): 5TB

  • Max supporting documentation file size: 100MB

  • Naming rules:

    • Name length: Between 3 and 80 characters

    • The escaped name (lowercase, collapse all non-alphanumeric characters to "_") must be unique across all datasets in the organization. If dataset is owned by a user, must also be unique across all workflows owned by that user.

Exports

  • Max monthly export: 100GB (unless your organization has configured a custom egress project)

  • Max export sizes:

    • CSV: 10TB

    • NDJSON: 10TB

    • Parquet: 10TB*

    • Avro: 10TB*

    • SAV: 10GB**

    • DTA: 10GB**

* Parquet and Avro exports larger than 1GB will be exported as a ZIP composed of multiple individual files of the corresponding format. ** To load larger files into SPSS, Stata, and SAS, you can export a CSV alongside the accompanying load script.

Notebooks

  • Max concurrent notebooks, per user: 5

  • Naming rules:

    • Name length: Between 1 and 80 characters

    • The escaped name (lowercase, collapse all non-alphanumeric characters to "_") must be unique across all transforms in the workflow.

Organizations

  • Max datasets per organization: 10,000

  • Max members per organization: 10,000

Queries

  • Max concurrent queries, per user: 5

  • Max queued queries, per user: 1,000

  • Max query duration: 6 hours

  • Max query output size: 10GB compressed (often >10GB)

  • Max query string length: 1M characters

  • Max query compute seconds: 100k

  • Max total query compute seconds (per 24hrs): 5M

Tables

  • Max size: 100TB

  • Max row size: 100MB

  • Max variables: 9,990 (across all versions of the table)*

  • Max description length: 5,000

  • Naming rules:

    • Name length: Between 1 and 80 characters

    • Disallowed names: _source_

    • The escaped name (lowercase, collapse all non-alphanumeric characters to "_") must be unique across tables in the associated dataset / workflow.

* While Redivis supports up to 9,990 variables per table, we strongly recommend restructuring your data to have fewer variables if possible. Such "wide" tables will generally be less performant and harder for researchers to navigate and query compared to "tall" tables with a few variables and many records.

Transforms

  • Max steps per transform: 100

  • Max concurrent transforms, per user: 5

  • Max generated SQL query string length: 1M characters

  • Max per-query compute seconds: 1M

  • Max transform output size: 1TB

  • Naming rules:

    • Name length: Between 1 and 80 characters

    • The escaped name (lowercase, collapse all non-alphanumeric characters to "_") must be unique across all transforms in the workflow.

Uploads

  • Max uploads per table, per version: 500*

  • Max file sizes, tabular uploads

    • Delimited (csv, tsv, etc.): 5TB**

    • jsonl, json, geojson, geojsonl, kml, xlsx: 5TB**

    • SAS(.sas7bdat): 5TB**

    • Avro, Parquet, ORC: 5TB

    • shp, shp.zip, Stata(.dta), SPSS(.sav), Excel(xls, xlsx): 100GB

  • Max file size, unstructured data files: 5TB

* Depending on the length of variable names, the actual limits for max uploads may be lower. In general, the total length of all variable names cannot exceed 185,000 characters, and the total number of variables multiplied by the total number of uploads (for a single version of the table) cannot exceed 400,000. If either of these limits are reached, the upload will fail with an accompanying error message. ** The 5TB limit applies to the final size of a file after decompression and/or conversion (e.g., SAS files are converted to CSV before final import, shapefiles are converted to geojson; this final file must be less than 5TB).

Variables

  • Max label length: 256

  • Max description length: 5,000

  • Value labels:

    • Value length cannot exceed 32 characters

    • Label length cannot exceed 256 characters

    • Total length cannot exceed 1M characters (sum of all values + labels)

  • Naming rules:

    • Name length: Between 1 and 60 characters

    • Only alphanumeric, "_" are allowed. Cannot begin with a number.

    • Must be unique within its table (casing ignored)

Workflows

  • Max data sources: 100

  • Max transforms: 1,000

  • Max notebooks: 1,000

  • Max tables: 1,000

  • Max parameters: 1,000

  • Max values per parameter: 10,000

  • Naming rules:

    • Name length: Between 3 and 80 characters

    • The escaped name (lowercase, collapse all non-alphanumeric characters to "_") must be unique across all datasets and workflows owned by the user.

Last updated