spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ayoub <benali.ayoub.i...@gmail.com>
Subject Re: HiveContext created SchemaRDD's saveAsTable is not working on 1.2.0
Date Fri, 30 Jan 2015 16:19:08 GMT
I am not personally aware of a repo for snapshot builds.
In my use case, I had to build spark 1.2.1-snapshot

see https://spark.apache.org/docs/latest/building-spark.html

2015-01-30 17:11 GMT+01:00 Debajyoti Roy <debajyoti.roy@healthagen.com>:

> Thanks Ayoub and Zhan,
> I am new to spark and wanted to make sure i am not trying something stupid
> or using a wrong API.
>
> Is there a repo where i can pull the snapshot or nighly builds for spark ?
>
>
>
> On Fri, Jan 30, 2015 at 2:45 AM, Ayoub Benali <benali.ayoub.info@gmail.com
> > wrote:
>
>> Hello,
>>
>> I had the same issue then I found this JIRA ticket
>> https://issues.apache.org/jira/browse/SPARK-4825
>> So I switched to Spark 1.2.1-snapshot witch solved the problem.
>>
>>
>>
>> 2015-01-30 8:40 GMT+01:00 Zhan Zhang <zzhang@hortonworks.com>:
>>
>>>  I think it is expected. Refer to the comments in saveAsTable "Note that
>>> this currently only works with SchemaRDDs that are created from a
>>> HiveContext". If I understand correctly, here the SchemaRDD means those
>>> generated by HiveContext.sql, instead of applySchema.
>>>
>>>  Thanks.
>>>
>>>  Zhan Zhang
>>>
>>>
>>>
>>>  On Jan 29, 2015, at 9:38 PM, matroyd <debajyoti.roy@healthagen.com>
>>> wrote:
>>>
>>> Hi, I am trying saveAsTable on SchemaRDD created from HiveContext and it
>>> fails. This is on Spark 1.2.0. Following are details of the code, command
>>> and exceptions:
>>> http://stackoverflow.com/questions/28222496/how-to-enable-sql-on-schemardd-via-the-jdbc-interface-is-it-even-possible
>>> <http://cp.mcafee.com/d/5fHCMUe6zqb2qrVEVso73ztPqdT7HLIcII6QrK6zBxNB55cSztNWXX3bbVJ6XxEVvjKOMedywEjS1454WNDm1yIiJendAWNDm1yIiJendS76zB4xpx_HYO-OMe7tuVtdBBzD1NEVKCqeumKzp55l55zBgY-F6lK1FJ4SOrLOtXTLuZXTdTdw0WjSNmFDUKDRcsLwITZ9OH2C9L9FFI6zBP2tj1uti_MQwvVuwIunH0LiNfRtywwncOQLcDVshg8mbOxfUKXrOYG5Vjb-p-1tqJai87-rrFYiYvCT61tdZxZYKa2xfo4jytoPH0Nm9mDbwGySNaZGSS9_M04SOevpdxuhDNaI9-7Pd45E_I_gd40NoDWKwIe3zhfgQgkQPUxg4WgfYQgiEq88lCq835oBpg8Cy2I3h0zOvndK3zsm65OVJP>
>>> Thanks in advance for any guidance
>>> ------------------------------
>>> View this message in context: HiveContext created SchemaRDD's
>>> saveAsTable is not working on 1.2.0
>>> <http://cp.mcafee.com/d/FZsScxNJ5xddYQsKc3xNKVJ6XzRTS6mm3qdT3hOMUOyyCrhKUZtZxBBYSztMQsLFTpo76Ngk9X0y2ytoPH0Nm9mDbCOtoPH0Nm9mDbCX3zhOygIM_R-pvpo73KLsKCOONPwUQsTjd7fbnhIyyGyyNOEuvkzaT0QSCrpdTVeZXTLuZXCXCM0uHroDVuySNaBSWv4KvaA-hLt5ZO_gpW6A21_YLwnApYiH2vxYOZE_I_gbz5yvGW2MUebQbQQPUxg4WgfYLaxu5pBP5oBpg8BWMbEBQOZOYRAQm6me1NJKDNbN-rso5QTS7TOUEa4Zwhe9RzeI35oBqsK2Gbr4HSHroD_00jr8VZAS5V6v4GMDUvcQgmz-PZ0Qg35yvGW2MUed4Z3h1jjfy50jF0_Ph1axEwxmpEwclylB0yq8aMd42f9ZsSUedGaVp>
>>> Sent from the Apache Spark User List mailing list archive
>>> <http://cp.mcafee.com/d/k-Kr43qb2qrVEVso73ztPqdT7HLIcII6QrK6zBxNB55cSztNWXX3bbVJ6XxEVvjKOMedywEjS1454WNDm1yIiJendAWNDm1yIiJendS76zB4xpx_HYO-OMe7tuVtdBBzD1NEVKCqeumKzp55l55zBgY-F6lK1FJASOrLOtXTLuZXTdTdw0ZmSNfOZ5JylbJQ-9s-l9YzuWbXB-wPQd843_Vv3rtfynzYSUMbFLIfLBNgk9X0ysjH6to6aNaQVs5kmS9nJmSNf-00CShPX9IbOc-9lxfM-pEwJ7ZDW1Ew6b4_lQ5xMsq9W6y2CCv4a0Di1_Cy2l3h12IPh0oH4Ha14Qglwq84ujWVJMsrlDSD>
>>> at Nabble.com.
>>>
>>>
>>>
>>
>
>
> --
> Thanks,
>
> *Debajyoti Roy*
> debajyoti.roy@healthagen.com
> (646)561-0844 <646-561-0844>
> 350 Madison Ave., FL 16,
> New York, NY 10017.
>




--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Re-HiveContext-created-SchemaRDD-s-saveAsTable-is-not-working-on-1-2-0-tp21442.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
Mime
View raw message