spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Heuer <heue...@gmail.com>
Subject Hadoop version(s) compatible with spark-2.4.3-bin-without-hadoop-scala-2.12
Date Mon, 20 May 2019 19:37:21 GMT
Hello,

Which Hadoop version or versions are compatible with Spark 2.4.3 and Scala 2.12?

The binary distribution spark-2.4.3-bin-without-hadoop-scala-2.12.tgz is missing avro-1.8.2.jar,
so when attempting to run with Hadoop 2.7.7 there are classpath conflicts at runtime, as Hadoop
2.7.7 includes avro-1.7.4.jar.

https://issues.apache.org/jira/browse/SPARK-27781 <https://issues.apache.org/jira/browse/SPARK-27781>

   michael
Mime
View raw message