spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From kant kodali <kanth...@gmail.com>
Subject is it ok to have multiple sparksession's in one spark structured streaming app?
Date Thu, 07 Sep 2017 00:40:15 GMT
Hi All,

I am wondering if it is ok to have multiple sparksession's in one spark
structured streaming app? Basically, I want to create 1) Spark session for
reading from Kafka and 2) Another Spark session for storing the mutations
of a dataframe/dataset to a persistent table as I get the mutations from
#1?

Finally, is this a common practice?

Thanks,
kant

Mime
View raw message