transform_sdf
transform a subset of column(s) in a Spark Dataframe
Description
transform a subset of column(s) in a Spark Dataframe
Usage
transform_sdf(x, cols, fn)Arguments
| Argument | Description |
|---|---|
| x | An object coercible to a Spark DataFrame |
| cols | Subset of columns to apply transformation to |
| fn | Transformation function taking column name as the 1st parameter, the |
corresponding org.apache.spark.sql.Column object as the 2nd parameter, and returning a transformed org.apache.spark.sql.Column object