spark-api
Access the Spark API
Description
Access the commonly-used Spark objects associated with a Spark instance. These objects provide access to different facets of the Spark API.
Usage
spark_context(sc)
java_context(sc)
hive_context(sc)
spark_session(sc)Arguments
| Argument | Description |
|---|---|
| sc | A spark_connection. |
Details
The https://spark.apache.org/docs/latest/api/scala/Scala API documentation is useful for discovering what methods are available for each of these objects. Use invoke to call methods on these objects.