spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "vr.n. nachiappan" <nachiappan_...@yahoo.com.INVALID>
Subject Saving data frames on Spark Master/Driver
Date Thu, 14 Jul 2016 22:15:40 GMT
Hello,
I am using data frames to join two cassandra tables.
Currently when i invoke save on data frames as shown below it is saving the join results on
executor nodes. 
joineddataframe.select(<col1>, <col2> ...).format("com.databricks.spark.csv").option("header",
"true").save(<path>)
I would like to persist the results of the join on Spark Master/Driver node. Is it possible
to save the results on Spark Master/Driver and how to do it.
I appreciate your help.
Nachi

Mime
View raw message