sdf_drop_duplicates
Remove duplicates from a Spark DataFrame
Description
Remove duplicates from a Spark DataFrame
Usage
sdf_drop_duplicates(x, cols = NULL)
Arguments
Argument | Description |
---|---|
x | An object coercible to a Spark DataFrame |
cols | Subset of Columns to consider, given as a character vector |