spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Cheng Lian <lian.cs....@gmail.com>
Subject Re: HiveContext created SchemaRDD's saveAsTable is not working on 1.2.0
Date Sat, 31 Jan 2015 03:19:13 GMT
Yeah, currently there isn't such a repo. However, the Spark team is 
working on this.

Cheng

On 1/30/15 8:19 AM, Ayoub wrote:
> I am not personally aware of a repo for snapshot builds.
> In my use case, I had to build spark 1.2.1-snapshot
>
> see https://spark.apache.org/docs/latest/building-spark.html
>
> 2015-01-30 17:11 GMT+01:00 Debajyoti Roy <[hidden email] 
> </user/SendEmail.jtp?type=node&node=21442&i=0>>:
>
>     Thanks Ayoub and Zhan,
>     I am new to spark and wanted to make sure i am not trying
>     something stupid or using a wrong API.
>
>     Is there a repo where i can pull the snapshot or nighly builds for
>     spark ?
>
>
>
>     On Fri, Jan 30, 2015 at 2:45 AM, Ayoub Benali <[hidden email]
>     </user/SendEmail.jtp?type=node&node=21442&i=1>> wrote:
>
>         Hello,
>
>         I had the same issue then I found this JIRA ticket
>         https://issues.apache.org/jira/browse/SPARK-4825
>         So I switched to Spark 1.2.1-snapshot witch solved the problem.
>
>
>
>         2015-01-30 8:40 GMT+01:00 Zhan Zhang <[hidden email]
>         </user/SendEmail.jtp?type=node&node=21442&i=2>>:
>
>             I think it is expected. Refer to the comments in
>             saveAsTable "Note that this currently only works with
>             SchemaRDDs that are created from a HiveContext”. If I
>             understand correctly, here the SchemaRDD means those
>             generated by HiveContext.sql, instead of applySchema.
>
>             Thanks.
>
>             Zhan Zhang
>
>
>
>             On Jan 29, 2015, at 9:38 PM, matroyd <[hidden email]
>             </user/SendEmail.jtp?type=node&node=21442&i=3>> wrote:
>
>>             Hi, I am trying saveAsTable on SchemaRDD created from
>>             HiveContext and it fails. This is on Spark 1.2.0.
>>             Following are details of the code, command and
>>             exceptions:
>>             http://stackoverflow.com/questions/28222496/how-to-enable-sql-on-schemardd-via-the-jdbc-interface-is-it-even-possible
>>             <http://cp.mcafee.com/d/5fHCMUe6zqb2qrVEVso73ztPqdT7HLIcII6QrK6zBxNB55cSztNWXX3bbVJ6XxEVvjKOMedywEjS1454WNDm1yIiJendAWNDm1yIiJendS76zB4xpx_HYO-OMe7tuVtdBBzD1NEVKCqeumKzp55l55zBgY-F6lK1FJ4SOrLOtXTLuZXTdTdw0WjSNmFDUKDRcsLwITZ9OH2C9L9FFI6zBP2tj1uti_MQwvVuwIunH0LiNfRtywwncOQLcDVshg8mbOxfUKXrOYG5Vjb-p-1tqJai87-rrFYiYvCT61tdZxZYKa2xfo4jytoPH0Nm9mDbwGySNaZGSS9_M04SOevpdxuhDNaI9-7Pd45E_I_gd40NoDWKwIe3zhfgQgkQPUxg4WgfYQgiEq88lCq835oBpg8Cy2I3h0zOvndK3zsm65OVJP>
>>             Thanks in advance for any guidance
>>             ------------------------------------------------------------------------
>>             View this message in context: HiveContext created
>>             SchemaRDD's saveAsTable is not working on 1.2.0
>>             <http://cp.mcafee.com/d/FZsScxNJ5xddYQsKc3xNKVJ6XzRTS6mm3qdT3hOMUOyyCrhKUZtZxBBYSztMQsLFTpo76Ngk9X0y2ytoPH0Nm9mDbCOtoPH0Nm9mDbCX3zhOygIM_R-pvpo73KLsKCOONPwUQsTjd7fbnhIyyGyyNOEuvkzaT0QSCrpdTVeZXTLuZXCXCM0uHroDVuySNaBSWv4KvaA-hLt5ZO_gpW6A21_YLwnApYiH2vxYOZE_I_gbz5yvGW2MUebQbQQPUxg4WgfYLaxu5pBP5oBpg8BWMbEBQOZOYRAQm6me1NJKDNbN-rso5QTS7TOUEa4Zwhe9RzeI35oBqsK2Gbr4HSHroD_00jr8VZAS5V6v4GMDUvcQgmz-PZ0Qg35yvGW2MUed4Z3h1jjfy50jF0_Ph1axEwxmpEwclylB0yq8aMd42f9ZsSUedGaVp>
>>             Sent from the Apache Spark User List mailing list archive
>>             <http://cp.mcafee.com/d/k-Kr43qb2qrVEVso73ztPqdT7HLIcII6QrK6zBxNB55cSztNWXX3bbVJ6XxEVvjKOMedywEjS1454WNDm1yIiJendAWNDm1yIiJendS76zB4xpx_HYO-OMe7tuVtdBBzD1NEVKCqeumKzp55l55zBgY-F6lK1FJASOrLOtXTLuZXTdTdw0ZmSNfOZ5JylbJQ-9s-l9YzuWbXB-wPQd843_Vv3rtfynzYSUMbFLIfLBNgk9X0ysjH6to6aNaQVs5kmS9nJmSNf-00CShPX9IbOc-9lxfM-pEwJ7ZDW1Ew6b4_lQ5xMsq9W6y2CCv4a0Di1_Cy2l3h12IPh0oH4Ha14Qglwq84ujWVJMsrlDSD>
>>             at Nabble.com <http://Nabble.com>.
>
>
>
>
>
>     -- 
>     Thanks,
>
>     *Debajyoti Roy*
>     [hidden email] </user/SendEmail.jtp?type=node&node=21442&i=4>
>     <a href="tel:646-561-0844" target="_blank">(646)561-0844
>     350 Madison Ave., FL 16,
>     New York, NY 10017.
>
>
>
> ------------------------------------------------------------------------
> View this message in context: Re: HiveContext created SchemaRDD's 
> saveAsTable is not working on 1.2.0 
> <http://apache-spark-user-list.1001560.n3.nabble.com/Re-HiveContext-created-SchemaRDD-s-saveAsTable-is-not-working-on-1-2-0-tp21442.html>
> Sent from the Apache Spark User List mailing list archive 
> <http://apache-spark-user-list.1001560.n3.nabble.com/> at Nabble.com.


Mime
View raw message