From common-issues-return-107780-apmail-hadoop-common-issues-archive=hadoop.apache.org@hadoop.apache.org Tue Apr 26 14:30:16 2016 Return-Path: X-Original-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D464719771 for ; Tue, 26 Apr 2016 14:30:16 +0000 (UTC) Received: (qmail 12483 invoked by uid 500); 26 Apr 2016 14:30:13 -0000 Delivered-To: apmail-hadoop-common-issues-archive@hadoop.apache.org Received: (qmail 12428 invoked by uid 500); 26 Apr 2016 14:30:13 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-issues@hadoop.apache.org Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 12021 invoked by uid 99); 26 Apr 2016 14:30:13 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 26 Apr 2016 14:30:13 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 3B4562C1F74 for ; Tue, 26 Apr 2016 14:30:13 +0000 (UTC) Date: Tue, 26 Apr 2016 14:30:13 +0000 (UTC) From: "Oleksiy Sayankin (JIRA)" To: common-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Work started] (HADOOP-13063) Incorrect error message while setting dfs.block.size to wrong value MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HADOOP-13063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-13063 started by Oleksiy Sayankin. ------------------------------------------------- > Incorrect error message while setting dfs.block.size to wrong value > ------------------------------------------------------------------- > > Key: HADOOP-13063 > URL: https://issues.apache.org/jira/browse/HADOOP-13063 > Project: Hadoop Common > Issue Type: Bug > Reporter: Oleksiy Sayankin > Assignee: Oleksiy Sayankin > > Execute in Hive > {code} > hive> SET dfs.block.size=32000000; > hive> select count(*) from test; > {code} > See logs > {code} > Query ID = vagrant_20160408135656_fd1937b3-b330-4d54-842a-0f3ec544ceea > Total jobs = 1 > Launching Job 1 out of 1 > Number of reduce tasks determined at compile time: 1 > In order to change the average load for a reducer (in bytes): > set hive.exec.reducers.bytes.per.reducer= > In order to limit the maximum number of reducers: > set hive.exec.reducers.max= > In order to set a constant number of reducers: > set mapreduce.job.reduces= > Starting Job = job_1460123221842_0001, Tracking URL = http://cdh-master:8088/proxy/application_1460123221842_0001/ > Kill Command = /usr/lib/hadoop/bin/hadoop job -kill job_1460123221842_0001 > Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 1 > 2016-04-08 13:57:18,494 Stage-1 map = 0%, reduce = 0% > 2016-04-08 13:58:06,821 Stage-1 map = 100%, reduce = 100% > Ended Job = job_1460123221842_0001 with errors > Error during job, obtaining debugging information... > Examining task ID: task_1460123221842_0001_m_000000 (and more) from job job_1460123221842_0001 > Task with the most failures(4): > ----- > Task ID: > task_1460123221842_0001_m_000000 > URL: > http://cdh-master:8088/taskdetails.jsp?jobid=job_1460123221842_0001&tipid=task_1460123221842_0001_m_000000 > ----- > Diagnostic Messages for this Task: > Exception from container-launch. > Container id: container_1460123221842_0001_01_000005 > Exit code: 1 > Stack trace: ExitCodeException exitCode=1: > at org.apache.hadoop.util.Shell.runCommand(Shell.java:561) > at org.apache.hadoop.util.Shell.run(Shell.java:478) > at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:738) > at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:210) > at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302) > at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Container exited with a non-zero exit code 1 > FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask > MapReduce Jobs Launched: > Stage-Stage-1: Map: 1 Reduce: 1 HDFS Read: 0 HDFS Write: 0 FAIL > Total MapReduce CPU Time Spent: 0 msec > {code} > We need to have more informative error message here -- This message was sent by Atlassian JIRA (v6.3.4#6332)