avro-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ieme...@apache.org
Subject [avro] branch master updated: AVRO-2318: Add hadoop3 profile run to validate support of Hadoop 3
Date Mon, 08 Apr 2019 16:32:53 GMT
This is an automated email from the ASF dual-hosted git repository.

iemejia pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/avro.git


The following commit(s) were added to refs/heads/master by this push:
     new a024956  AVRO-2318: Add hadoop3 profile run to validate support of Hadoop 3
a024956 is described below

commit a02495613d514e984ff486f334890099b1c922e7
Author: Ismaël Mejía <iemejia@gmail.com>
AuthorDate: Mon Apr 8 13:15:38 2019 +0200

    AVRO-2318: Add hadoop3 profile run to validate support of Hadoop 3
    
    Notice that hadoop 3 uses a version of jetty that does not depend on
    jetty-util so we need to explictly add it to ipc-jetty to avoid runtime
    issues (ClassNotFoundException) in Avro's tools with Hadoop 3.
---
 lang/java/build.sh          |  2 ++
 lang/java/ipc-jetty/pom.xml |  4 ++++
 lang/java/pom.xml           | 11 +++++++++++
 3 files changed, 17 insertions(+)

diff --git a/lang/java/build.sh b/lang/java/build.sh
index e1492c7..db800fc 100755
--- a/lang/java/build.sh
+++ b/lang/java/build.sh
@@ -44,6 +44,8 @@ function do_dist() {
 case "$target" in
   test)
     mvn -B test
+    # Test the modules that depend on hadoop using Hadoop 3
+    mvn -B test -Phadoop3
     ;;
 
   dist)
diff --git a/lang/java/ipc-jetty/pom.xml b/lang/java/ipc-jetty/pom.xml
index c3ad911..780725f 100644
--- a/lang/java/ipc-jetty/pom.xml
+++ b/lang/java/ipc-jetty/pom.xml
@@ -109,6 +109,10 @@
         <groupId>org.eclipse.jetty</groupId>
         <artifactId>jetty-servlet</artifactId>
     </dependency>
+    <dependency>
+      <groupId>org.eclipse.jetty</groupId>
+      <artifactId>jetty-util</artifactId>
+    </dependency>
   </dependencies>
 
 </project>
diff --git a/lang/java/pom.xml b/lang/java/pom.xml
index a27689e..9cfafda 100644
--- a/lang/java/pom.xml
+++ b/lang/java/pom.xml
@@ -475,6 +475,12 @@
         </plugins>
       </build>
     </profile>
+    <profile>
+      <id>hadoop3</id>
+      <properties>
+        <hadoop.version>3.2.0</hadoop.version>
+      </properties>
+    </profile>
   </profiles>
 
   <!-- dependencyManagement can be used to define dependency versions, scopes, and
@@ -509,6 +515,11 @@
           <version>${jetty.version}</version>
       </dependency>
       <dependency>
+        <groupId>org.eclipse.jetty</groupId>
+        <artifactId>jetty-util</artifactId>
+        <version>${jetty.version}</version>
+      </dependency>
+      <dependency>
           <groupId>javax.servlet</groupId>
           <artifactId>javax.servlet-api</artifactId>
           <version>${servlet-api.version}</version>


Mime
View raw message