spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gang Li <lg1173298...@gmail.com>
Subject Re: For the same data source in two SQLs, how to read it once?
Date Wed, 09 Sep 2020 09:01:29 GMT
Writing to the temporary table does allow the data source to read once, but
writing to the temporary table will have disk I/O operations, and there is
no effective use of Spark RDD's memory-based operations

<http://apache-spark-developers-list.1001551.n3.nabble.com/file/t3738/tmp1.png> 



--
Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org


Mime
View raw message