spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: registerTempTable is not a member of RDD on spark 1.2?
Date Mon, 23 Mar 2015 13:50:18 GMT
Have you tried adding the following ?

import org.apache.spark.sql.SQLContext

Cheers

On Mon, Mar 23, 2015 at 6:45 AM, IT CTO <goi.cto@gmail.com> wrote:

> Thanks.
> I am new to the environment and running cloudera CDH5.3 with spark in it.
>
> apparently when running in spark-shell this command  val sqlContext = new
> SQLContext(sc)
> I am failing with the not found type SQLContext
>
> Any idea why?
>
> On Mon, Mar 23, 2015 at 3:05 PM, Dean Wampler <deanwampler@gmail.com>
> wrote:
>
>> In 1.2 it's a member of SchemaRDD and it becomes available on RDD
>> (through the "type class" mechanism) when you add a SQLContext, like so.
>>
>> val sqlContext = new SQLContext(sc)import sqlContext._
>>
>>
>> In 1.3, the method has moved to the new DataFrame type.
>>
>> Dean Wampler, Ph.D.
>> Author: Programming Scala, 2nd Edition
>> <http://shop.oreilly.com/product/0636920033073.do> (O'Reilly)
>> Typesafe <http://typesafe.com>
>> @deanwampler <http://twitter.com/deanwampler>
>> http://polyglotprogramming.com
>>
>> On Mon, Mar 23, 2015 at 5:25 AM, IT CTO <goi.cto@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> I am running spark when I use sc.version I get 1.2 but when I call
>>> registerTempTable("MyTable") I get error saying registedTempTable is not a
>>> member of RDD
>>>
>>> Why?
>>>
>>> --
>>> Eran | CTO
>>>
>>
>>
>
>
> --
> Eran | CTO
>

Mime
View raw message