pyspark.sql.SparkSession.newSession#

SparkSession.newSession()[source]#

Returns a new SparkSession as new session, that has separate SQLConf, registered temporary views and UDFs, but shared SparkContext and table cache.

Added in version 2.0.0.

Returns:

SparkSession: Spark session if an active session exists for the current thread

Examples

>>> spark.newSession()
<...SparkSession object ...>