Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

why stop() function doesn't work correctly? #3

Open
dubaicv opened this issue May 19, 2020 · 0 comments
Open

why stop() function doesn't work correctly? #3

dubaicv opened this issue May 19, 2020 · 0 comments

Comments

@dubaicv
Copy link

dubaicv commented May 19, 2020

`conf = (SparkConf()
#.setMaster("local")
.setMaster("spark://master:7077")
.setAppName("My_APP")
.set("spark.executor.cores", '1')
.set("spark.scheduler.mode", "FAIR")
)

sess = SparkSession.builder.config(conf=conf).getOrCreate()
sess.stop()
DataFrame = sess.sql("show tables")
print(DataFrame)
print(sess)`

This is the program output:
DataFrame[database: string, tableName: string, isTemporary: boolean] <pyspark.sql.session.SparkSession object at 0x7fe3b8e709b0>

Why is sparksesion not closed and what can I do to close it? Thank you

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant