Drop duplicates and advanced

Drop duplicates

Dropping duplicates allows for you to combine and collapse the rows in your table. By turning this option on, all records that are identical in all variables in the Keep section (of the variable selector at the top of the transform) will be collapsed into one record.

Order rows

You can specify row order on the output table according to the values of a variable of your choice.

For example, we can sort our output table rows alphabetically by provider_name using the Low to high option.

Limit output table size

You can limit the size of the output table by an integer number of rows. Note that this will not reduce the compute cost of your query, but it may execute faster and will reduce the storage cost of your output table.

For example, we can ensure our output table only has the first 10000 rows, according to the ordering specified above.