Table$add_files

Table$add_files(files=NULL, directory=NULL, max_parallelization=parallelly::availableCores()) → list(File)

Uploads either a list of files or all files in a directory to an index table. The index table must be on an unreleased version. Attempting to add files to a non-index table will result in an error.

Parameters:

files : list(str | list(path=str, name=str, data=str | raw | connection)), default None A list of files to upload. Either this or directory must be specified, but not both. Can either be a list of file paths, or a list of named lists with the keys path, name, and/or data. If providing named lists, each entry must specify either path (the path to the file on disk) or data, representing the content to upload, which can either be a raw vector or connection. name is optional if path is specified (defaulting to the file name), but required if data is specified.

directory : str, default None A directory of files to upload. Either this or files must be specified, but not both. All files in the directory will be uploaded, including hidden files and those in any subdirectories.

max_parallelization : int, default parallelly::availableCores() The maximum concurrency when uploading files. If you have lots of small files, you may want to increase the concurrency, while you may want to decrease it if you have just a few large files.

Returns:

list(File)

Examples:

library(redivis)
dataset <- redivis$user("user_name")$dataset("dataset_name", version="next")

# Non-tabular files must be uploaded to file index tables
table <- dataset$table("my_files")$create(is_file_index=TRUE)

# upload all contents in a directory
table$add_files(directory="/path/to/directory/")

# upload specific files
table$add_files(files=list(
    "/path/to/file.png", # file name will be "file.png"
    list(path="/path/to/other/file.png", name="other_file.png"), # file name will be other_file.png
    list(data="Hello world", name="hello_world.txt") # Data can be string or raw vector 
    list(data=url("http://example.com"), name="example_com.html") # Data can be a connection
)