spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joanne Contact <joannenetw...@gmail.com>
Subject Re: unable to read avro file
Date Sat, 28 Mar 2015 05:06:35 GMT
never mind. find my spark is still 1.2 but the avro library requires 1.3.
will try again.

On Fri, Mar 27, 2015 at 9:38 PM, Joanne Contact <joannenetwork@gmail.com>
wrote:

> Hi I am following the instruction on this website.
> http://www.infoobjects.com/spark-with-avro/
>
> I installed the sparkavro libary on https://
> github.com/databricks/spark-avro
> on a machine which only has hive gateway client role on a hadoop cluster.
>
> somehow I got error on reading the avro file.
>
> scala> val ufos =
> sqlContext.avroFile("hdfs://sssssss/xxxxx/iiiiiiiiiii/iiiiiiiiiiiAaaaSsssss/hhhhhh/2222/00/22/22/iiiiiiiiiiiAaaaSsssss.6.11.469465.
> 2099222123.1427497200000.avro")
>
> <console>:20: error: erroneous or inaccessible type
>        val ufos =
> sqlContext.avroFile("hdfs://sssssss/xxxxx/iiiiiiiiiii/iiiiiiiiiiiAaaaSsssss/hhhhhh/2222/00/22/22/iiiiiiiiiiiAaaaSsssss.6.11.469465.
> 2099222123.1427497200000.avro")
>
> Any advice please?
>
> Thank you!
>
> J
>

Mime
View raw message