columns
[array[string], null]

Names of columns used to detect and filter rows containing duplicate values. If not provided, will inspect all columns. Note that multivalued columns, i.e. those containing lists of values will always be ignored when searching for duplicates (but will be included in the result).

keep
string
default: "first"

Which of a duplicate set of rows to keep in the result. Specifically, whether to keep the first or last row amongst the duplicates.

Values must be one of the following:

  • first
  • last
exclude
boolean

if true, inverts the row selection. I.e., only rows being duplicates (in the selected columns) will be included in the resulting dataset.