spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Adam Gilmore <>
Subject Issue with Parquet on Spark 1.2 and Amazon EMR
Date Mon, 22 Dec 2014 01:37:47 GMT
Hi all,

I've just launched a new Amazon EMR cluster and used the script at:


to install Spark (this script was upgraded to support 1.2).

I know there are tools to launch a Spark cluster in EC2, but I want to use

Everything installs fine; however, when I go to read from a Parquet file, I
end up with (the main exception):

Caused by: java.lang.NoSuchMethodError:
        ... 55 more

It seems to me like a version mismatch somewhere.  Where is the
parquet-hadoop jar coming from?  Is it built into a fat jar for Spark?

Any help would be appreciated.  Note that 1.1.1 worked fine with Parquet

View raw message