tbl_cache
Cache a Spark Table
Description
Force a Spark table with name name
to be loaded into memory. Operations on cached tables should normally (although not always) be more performant than the same operation performed on an uncached table.
Usage
tbl_cache(sc, name, force = TRUE)
Arguments
Argument | Description |
---|---|
sc | A spark_connection . |
name | The table name. |
force | Force the data to be loaded into memory? This is accomplished |
by calling the count
API on the associated Spark DataFrame.