spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Armbrust <mich...@databricks.com>
Subject Re: SQLCtx cacheTable
Date Fri, 01 Aug 2014 02:42:29 GMT
cacheTable uses a special columnar caching technique that is optimized for
SchemaRDDs.  It something similar to MEMORY_ONLY_SER but not quite.  You
can specify the persistence level on the SchemaRDD itself and register that
as a temporary table, however it is likely you will not get as good
performance.


On Thu, Jul 31, 2014 at 6:16 AM, Gurvinder Singh <gurvinder.singh@uninett.no
> wrote:

> Hi,
>
> I am wondering how can I specify the persistence level in cacheTable. As
> it is takes only table name as parameter. It should be possible to
> specify the persistence level.
>
> - Gurvinder
>

Mime
View raw message