spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephen Boesch <java...@gmail.com>
Subject Selecting download for 'hadoop 2.4 and later"
Date Fri, 01 May 2015 20:30:52 GMT
What is the correct procedure for downloading a  spark 1.2.X release for
use with hadoop2.4?

The existing download page has a link for hadoop 2.4+. However when using
that with hadoop 2.4 an exception is thrown NoSuchMethodError for
Statistics.getThreadStatistics.

Upon brief investigation:   The SparkHadoopUtil class invokes the hadoop
FileSystem.Statistics.getThreadStatistics which exists in  hadoop 2.5+

Mime
View raw message