spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Cheng Lian (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-5177) Add environment variables in dev/run-tests to enable Hive 0.12 and Scala 2.11 Jenkins builder
Date Fri, 09 Jan 2015 16:24:34 GMT
Cheng Lian created SPARK-5177:
---------------------------------

             Summary: Add environment variables in dev/run-tests to enable Hive 0.12 and Scala
2.11 Jenkins builder
                 Key: SPARK-5177
                 URL: https://issues.apache.org/jira/browse/SPARK-5177
             Project: Spark
          Issue Type: Test
          Components: Build
    Affects Versions: 1.2.0
            Reporter: Cheng Lian


Currently, we don't have separate Jenkins builder for Hive 0.12.0 and Scala 2.11.

The PR builder executes {{dev/run-tests}}, which first compiles Spark against Hive 0.12.0,
discards compiled artifacts, and then compiles again and executes unit tests against 0.13.1.
However, code paths in the Hive 0.12.0 shim are different from Hive 0.13.1 shim, which can’t
be tested in this way. By adding dedicated builders for Hive 0.12.0, we can also reduce average
PR build time by avoiding compiling both Hive 0.12.0 and 0.13.1.

Scala 2.11 is not tested on Jenkins at all.

This ticket can be done in two steps:

# Add parameters for Hive version and Scala version in {{dev/run-tests}} to enable Jenkins
to control them via environment variables.
# Add dedicated Jenkins builders.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message