sdf_drop_duplicates

Remove duplicates from a Spark DataFrame

Description

Remove duplicates from a Spark DataFrame

Usage

sdf_drop_duplicates(x, cols = NULL)

Arguments

Argument Description
x An object coercible to a Spark DataFrame
cols Subset of Columns to consider, given as a character vector