checkpoint_directory
Set/Get Spark checkpoint directory
Description
Set/Get Spark checkpoint directory
Usage
spark_set_checkpoint_dir(sc, dir)
spark_get_checkpoint_dir(sc)
Arguments
Argument | Description |
---|---|
sc | A spark_connection . |
dir | checkpoint directory, must be HDFS path of running on cluster |