spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Enrico Minardi <enrico.mina...@hotmail.com>
Subject [apache-spark][Spark SQL][Debug] Maven Spark build fails while compiling spark-hive-thriftserver_2.12 for Hadoop 2.10.1
Date Fri, 17 Sep 2021 11:38:55 GMT

Hello,


the Maven build of Apache Spark 3.1.2 for user-provided Hadoop 2.10.1 with Hive and Hive-Thriftserver
profiles fails while compiling spark-hive-thriftserver_2.12.


I am most probably missing something. Could you please help?


I have searched the Scala-Maven-Plugin website (https://davidb.github.io/scala-maven-plugin/usage.html),
Stack Overflow / Stack Exchange, and the ASF user-list archive, but could not progress on
this issue.


The Maven version is 3.6.3, Scala version is the 2.12 (not installed, as mentioned here: https://davidb.github.io/scala-maven-plugin/index.html).



Thank you very much for any suggestion. I would be very appreciated.


Kind regards,

Enrico

----------


The error message is:


Failed to execute goal net.alchim31.maven:scala-maven-plugin:4.3.0:compile (scala-compile-first)
on project spark-hive-thriftserver_2.12: Execution scala-compile-first of goal
net.alchim31.maven:scala-maven-plugin:4.3.0:compile failed: java.lang.AssertionError: assertion
failed: Expected protocol to be 'file' or empty in URI jar:file:/home/vmuser/.m2/repository/org/eclipse/jetty/jetty-server/9.4.40.v20210413/jetty-server-9.4.40.v20210413.jar!/org/eclipse/jetty/server/AbstractConnectionFactory.class



I have adjusted the ./pom.xml as follows:


<profile>
      <id>hadoop-provided</id>
      <properties>
        <hadoop.version>2.10.1</hadoop.version>
        <curator.version>2.13.0</curator.version>
        <commons-io.version>2.4</commons-io.version>
        <javax.servlet-api.name>servlet-api</javax.servlet-api.name>
      </properties>
(...)


The command I run is:


./dev/make-distribution.sh -X -q -Phadoop-provided -Pyarn -Pkubernetes -Pscala-2.12 -Phive
-Phive-thriftserver -DzincPort=3036


Mime
View raw message