hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Chauhan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-15016) Run tests with Hadoop 3.0.0-beta1
Date Tue, 31 Oct 2017 22:37:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-15016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227718#comment-16227718
] 

Ashutosh Chauhan commented on HIVE-15016:
-----------------------------------------

Figured {{TestAcidOnTez}} Failures are because default value for few configs changed b/w 2.8
vs 3.1. With following change test passes.
{code}
diff --git a/itests/hive-unit/src/test/java/org/apache/hadoop/hive/ql/TestAcidOnTez.java b/itests/hive-unit/src/test/java/org/apache/hadoop/hive/ql/TestAcidOnTez.java
index dbfc23510c..65a1ed110e 100644
--- a/itests/hive-unit/src/test/java/org/apache/hadoop/hive/ql/TestAcidOnTez.java
+++ b/itests/hive-unit/src/test/java/org/apache/hadoop/hive/ql/TestAcidOnTez.java
@@ -49,6 +49,7 @@
 import org.apache.hadoop.hive.ql.lockmgr.TestDbTxnManager2;
 import org.apache.hadoop.hive.ql.processors.CommandProcessorResponse;
 import org.apache.hadoop.hive.ql.session.SessionState;
+import org.apache.tez.mapreduce.hadoop.MRJobConfig;
 import org.junit.After;
 import org.junit.Assert;
 import org.junit.Before;
@@ -106,6 +107,8 @@ public void setUp() throws Exception {
         .setVar(HiveConf.ConfVars.HIVE_AUTHORIZATION_MANAGER,
             "org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAuthorizerFactory");
     TxnDbUtil.setConfValues(hiveConf);
+    hiveConf.setInt(MRJobConfig.MAP_MEMORY_MB, 1024);
+    hiveConf.setInt(MRJobConfig.REDUCE_MEMORY_MB, 1024);
     TxnDbUtil.prepDb(hiveConf);
     File f = new File(TEST_WAREHOUSE_DIR);
     if (f.exists()) {
{code}
[~aihuaxu] Can you incorporate above also in your patch?

> Run tests with Hadoop 3.0.0-beta1
> ---------------------------------
>
>                 Key: HIVE-15016
>                 URL: https://issues.apache.org/jira/browse/HIVE-15016
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Hive
>    Affects Versions: 3.0.0
>            Reporter: Sergio Peña
>            Assignee: Aihua Xu
>         Attachments: HIVE-15016.2.patch, HIVE-15016.3.patch, HIVE-15016.4.patch, HIVE-15016.5.patch,
HIVE-15016.6.patch, HIVE-15016.7.patch, HIVE-15016.8.patch, HIVE-15016.9.patch, HIVE-15016.patch,
Hadoop3Upstream.patch
>
>
> Hadoop 3.0.0-alpha1 was released back on Sep/16 to allow other components run tests against
this new version before GA.
> We should start running tests with Hive to validate compatibility against Hadoop 3.0.
> NOTE: The patch used to test must not be committed to Hive until Hadoop 3.0 GA is released.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message