hadoop-mapreduce-dev mailing list archives: June 2010

Site index · List index
Message list1 · 2 · Next »Thread · Author · Date
WANG Shicai Need Suggestion: Tuning MR performance by changing parameters in Hadoop project and JVM Wed, 02 Jun, 07:52
WANG Shicai which parameters can jobs use differently in the same cluster? Fri, 11 Jun, 02:48
Aaron Kimball (JIRA) [jira] Created: (MAPREDUCE-1878) Add MRUnit documentation Sat, 19 Jun, 01:50
Aaron Kimball (JIRA) [jira] Created: (MAPREDUCE-1887) MRAsyncDiskService does not properly absolutize volume root paths Tue, 22 Jun, 20:20
Age Mooij (JIRA) [jira] Created: (MAPREDUCE-1842) JobID.forName() creates JobID instances that break equality Fri, 04 Jun, 12:14
Allen Wittenauer (JIRA) [jira] Created: (MAPREDUCE-1847) capacity scheduler job tasks summaries are wrong if nodes fail Tue, 08 Jun, 22:36
Allen Wittenauer (JIRA) [jira] Created: (MAPREDUCE-1869) TaskTracker hung in org.apache.hadoop.fs.LocalDirAllocator Tue, 15 Jun, 22:57
Allen Wittenauer (JIRA) [jira] Created: (MAPREDUCE-1884) Remove/deprecate mapred.map.tasks tunable Tue, 22 Jun, 01:47
Amar Kamat (JIRA) [jira] Created: (MAPREDUCE-1840) [Gridmix] Exploit/Add security features in GridMix Thu, 03 Jun, 05:51
Amar Kamat (JIRA) [jira] Created: (MAPREDUCE-1844) Tests failing with java.lang.NoClassDefFoundError Mon, 07 Jun, 08:10
Amar Kamat (JIRA) [jira] Created: (MAPREDUCE-1863) [Rumen] Null failedMapAttemptCDFs in job traces generated by Rumen Mon, 14 Jun, 09:24
Amar Kamat (JIRA) [jira] Created: (MAPREDUCE-1865) [Rumen] Rumen should also support jobhistory files generated using trunk Tue, 15 Jun, 06:04
Amar Kamat (JIRA) [jira] Created: (MAPREDUCE-1876) TaskAttemptStartedEvent.java incorrectly logs MAP_ATTEMPT_STARTED as event type for reduce tasks Fri, 18 Jun, 04:45
Amareshwari Sriramadasu (JIRA) [jira] Resolved: (MAPREDUCE-1350) Streaming should allow TextInputFormat keys to be passed through Wed, 02 Jun, 05:04
Amareshwari Sriramadasu (JIRA) [jira] Created: (MAPREDUCE-1834) TestSimulatorDeterministicReplay timesout on trunk Wed, 02 Jun, 07:57
Amareshwari Sriramadasu (JIRA) [jira] Created: (MAPREDUCE-1835) TestDelegationTokenRenewal token fails sometimes in branch 0.21 Wed, 02 Jun, 09:41
Amareshwari Sriramadasu (JIRA) [jira] Resolved: (MAPREDUCE-137) org.apache.hadoop.mapred.TestJobDirCleanup.testJobDirCleanup timesout occasionally Mon, 07 Jun, 07:42
Amareshwari Sriramadasu (JIRA) [jira] Resolved: (MAPREDUCE-596) can't package zip file with hadoop streaming -file argument Tue, 08 Jun, 11:54
Amareshwari Sriramadasu (JIRA) [jira] Resolved: (MAPREDUCE-1781) option "-D mapred.tasktracker.map.tasks.maximum=1" does not work when no of mappers is bigger than no of nodes - always spawns 2 mapers/node Wed, 09 Jun, 05:14
Amareshwari Sriramadasu (JIRA) [jira] Resolved: (MAPREDUCE-588) streaming failed without printing out the cause (IllegalArgumentException) Wed, 09 Jun, 05:17
Amareshwari Sriramadasu (JIRA) [jira] Resolved: (MAPREDUCE-616) Streaming: when a job is killed, the message should say it was "killed" rather than "failed" Wed, 09 Jun, 07:13
Amareshwari Sriramadasu (JIRA) [jira] Resolved: (MAPREDUCE-578) Unit test fails on linux: org.apache.hadoop.streaming.TestStreamingExitStatus.testReduceFailNotOk Wed, 09 Jun, 07:20
Amareshwari Sriramadasu (JIRA) [jira] Resolved: (MAPREDUCE-607) Streaming has its own methods to monitor jobs. It should use the jobclient methods to monitor the jobs Wed, 09 Jun, 07:29
Amareshwari Sriramadasu (JIRA) [jira] Created: (MAPREDUCE-1851) Document configuration parameters in streaming Thu, 10 Jun, 04:32
Amareshwari Sriramadasu (JIRA) [jira] Created: (MAPREDUCE-1852) build/test path is hardcoded in many testcases. Thu, 10 Jun, 05:01
Amareshwari Sriramadasu (JIRA) [jira] Resolved: (MAPREDUCE-499) Revert extra debugging Fri, 11 Jun, 07:58
Amareshwari Sriramadasu (JIRA) [jira] Created: (MAPREDUCE-1857) Remove unused stream.numinputspecs configuration Fri, 11 Jun, 08:12
Amareshwari Sriramadasu (JIRA) [jira] Created: (MAPREDUCE-1864) PipeMapRed.java has unintialized members log_ and LOGNAME Tue, 15 Jun, 05:30
Amareshwari Sriramadasu (JIRA) [jira] Created: (MAPREDUCE-1866) Remove deprecated class org.apache.hadoop.streaming.UTF8ByteArrayUtils Tue, 15 Jun, 08:33
Amareshwari Sriramadasu (JIRA) [jira] Created: (MAPREDUCE-1867) Remove unused methods in org.apache.hadoop.streaming.StreamUtil Tue, 15 Jun, 09:33
Amareshwari Sriramadasu (JIRA) [jira] Resolved: (MAPREDUCE-580) Streaming doesn't accept -cluster local Tue, 15 Jun, 09:45
Amareshwari Sriramadasu (JIRA) [jira] Resolved: (MAPREDUCE-582) Streaming: if streaming command finds errors in the --config , it reports that the input file is not found and fails Tue, 15 Jun, 11:44
Amareshwari Sriramadasu (JIRA) [jira] Created: (MAPREDUCE-1888) Streaming overrides user given output key and value types. Wed, 23 Jun, 04:33
Amareshwari Sriramadasu (JIRA) [jira] Resolved: (MAPREDUCE-978) -file option in streaming does not preserve execute permissions Wed, 23 Jun, 05:40
Amareshwari Sriramadasu (JIRA) [jira] Created: (MAPREDUCE-1895) MapEventFetcherThread should not iterate over jobs that are not localized Fri, 25 Jun, 05:51
Amareshwari Sriramadasu (JIRA) [jira] Reopened: (MAPREDUCE-1888) Streaming overrides user given output key and value types. Wed, 30 Jun, 07:56
Arun C Murthy Re: What is the reason for putting the output of one mapper task into one file ? Thu, 17 Jun, 14:57
Arun C Murthy (JIRA) [jira] Created: (MAPREDUCE-1841) o.a.h.mapreduce.FileOutputCommitter doens't check for existence of ${mapred.output.dir}/_temporary Thu, 03 Jun, 18:44
Arun C Murthy (JIRA) [jira] Created: (MAPREDUCE-1843) Allow for map and reduce specific DistributedCache artifacts Mon, 07 Jun, 05:57
Arun C Murthy (JIRA) [jira] Created: (MAPREDUCE-1872) Re-think (user|queue) limits on (tasks|jobs) in the CapacityScheduler Wed, 16 Jun, 17:26
Arun C Murthy (JIRA) [jira] Resolved: (MAPREDUCE-1875) Need sample map reduce program for arithmetic calculations from text files and produce the results in hadoop 0.20.2 Thu, 17 Jun, 15:00
Balaji Rajagopalan (JIRA) [jira] Created: (MAPREDUCE-1854) [herriot] Automate health script system test Thu, 10 Jun, 17:34
Balaji Rajagopalan (JIRA) [jira] Created: (MAPREDUCE-1882) Use Jsch instead of Shell.java Mon, 21 Jun, 11:35
Balaji Rajagopalan (JIRA) [jira] Created: (MAPREDUCE-1883) herriot bug with getDaemonConf Mon, 21 Jun, 11:45
Balaji Rajagopalan (JIRA) [jira] Created: (MAPREDUCE-1889) [herriot] Ability to restart a single node for pushconfig Wed, 23 Jun, 08:40
Boris Shkolnik (JIRA) [jira] Created: (MAPREDUCE-1836) Refresh for proxy superuser config (mr part for HDFS-1096) Wed, 02 Jun, 17:21
Boris Shkolnik (JIRA) [jira] Created: (MAPREDUCE-1855) refreshSuperUserGroupsConfiguration for MR should use server side configuration for the refresh (for HADOOP-6815) Thu, 10 Jun, 17:54
Chris Douglas Re: Is there any tool in Hadoop for MR job profiling Mon, 07 Jun, 03:56
Chris Douglas New Common/MapReduce committer: Amareshwari Sriramadasu Mon, 07 Jun, 07:36
Chris Douglas (JIRA) [jira] Resolved: (MAPREDUCE-1844) Tests failing with java.lang.NoClassDefFoundError Fri, 25 Jun, 20:43
Christian Kunz (JIRA) [jira] Reopened: (MAPREDUCE-1286) Quotes in environment HADOOP_CLIENT_OPTS confuse parsing if this env is concatenated with something else Mon, 21 Jun, 01:37
Devaraj Das (JIRA) [jira] Resolved: (MAPREDUCE-1599) MRBench reuses jobConf and credentials there in. Tue, 01 Jun, 22:33
Devaraj Das (JIRA) [jira] Resolved: (MAPREDUCE-1516) JobTracker should issue a delegation token only for kerberos authenticated client Fri, 11 Jun, 21:48
Devaraj Das (JIRA) [jira] Resolved: (MAPREDUCE-1855) refreshSuperUserGroupsConfiguration for MR should use server side configuration for the refresh (for HADOOP-6815) Wed, 23 Jun, 00:25
Devaraj Das (JIRA) [jira] Created: (MAPREDUCE-1900) MapReduce daemons should close FileSystems that are not needed anymore Mon, 28 Jun, 18:58
Doug Cutting Re: [RT] map reduce "pipelines" Mon, 14 Jun, 23:09
Eli Collins Re: Contributor Meeting Minutes 05/28/2010 Tue, 01 Jun, 19:25
Eli Collins (JIRA) [jira] Resolved: (MAPREDUCE-1858) TestCopyFiles fails consistently on trunk Sun, 13 Jun, 04:42
Giridharan Kesavan (JIRA) [jira] Created: (MAPREDUCE-1886) test org.apache.hadoop.mapred.TestMiniMRChildTask.testTaskEnv fails trunk builds Tue, 22 Jun, 08:58
Gordon Sommers streamxmlrecordreader alternatives Thu, 17 Jun, 15:54
Gordon Sommers Re: Need Sample map reduce program Fri, 18 Jun, 14:34
Greg Roelofs (JIRA) [jira] Resolved: (MAPREDUCE-1795) add error option if file-based record-readers fail to consume all input (e.g., concatenated gzip, bzip2) Thu, 10 Jun, 21:59
Greg Roelofs (JIRA) [jira] Created: (MAPREDUCE-1897) trunk build broken on compile-mapred-test Fri, 25 Jun, 23:38
Hong Tang (JIRA) [jira] Created: (MAPREDUCE-1833) [gridmix3] limit the maximum task duration in sleep job. Wed, 02 Jun, 07:11
Iyappan Srinivasan (JIRA) [jira] Created: (MAPREDUCE-1871) Create automated test scenario for "Collect information about number of tasks succeeded / total per time unit for a tasktracker" Wed, 16 Jun, 07:34
Iyappan Srinivasan (JIRA) [jira] Created: (MAPREDUCE-1890) Create automated test scenarios for decommissioning of task trackers Wed, 23 Jun, 09:32
Jeff Hammerbacher (JIRA) [jira] Created: (MAPREDUCE-1849) Implement a FlumeJava-like library for operations over parallel collections using Hadoop MapReduce Wed, 09 Jun, 21:41
Jeff Zhang What is the reason for putting the output of one mapper task into one file ? Thu, 17 Jun, 02:53
Jeff Zhang Re: What is the reason for putting the output of one mapper task into one file ? Thu, 17 Jun, 16:23
Johannes Zillmann (JIRA) [jira] Created: (MAPREDUCE-1859) maxConcurrentMapTask & maxConcurrentReduceTask per job Fri, 11 Jun, 11:11
Joydeep Sen Sarma (JIRA) [jira] Created: (MAPREDUCE-1860) LocalJobRunner should not use JT filesystem to qualify systemdir Fri, 11 Jun, 20:56
Joydeep Sen Sarma (JIRA) [jira] Resolved: (MAPREDUCE-1860) LocalJobRunner should use local filesystem to qualify systemdir Sat, 12 Jun, 00:04
Joydeep Sen Sarma (JIRA) [jira] Created: (MAPREDUCE-1862) Distributed Cache doesn't accept paths from non-default filesystems Sat, 12 Jun, 04:55
Joydeep Sen Sarma (JIRA) [jira] Created: (MAPREDUCE-1901) Jobs should not submit the same jar files over and over again Wed, 30 Jun, 19:22
Joydeep Sen Sarma (JIRA) [jira] Created: (MAPREDUCE-1902) job jar file is not distributed via DistributedCache Wed, 30 Jun, 22:26
Kai Ren (JIRA) [jira] Created: (MAPREDUCE-1873) Add a metrics instrumentation class to collect metrics about fair share scheduler Wed, 16 Jun, 18:26
Karam Singh (JIRA) [jira] Resolved: (MAPREDUCE-595) streaming command line does not honor -jt option Tue, 15 Jun, 11:49
Karam Singh (JIRA) [jira] Resolved: (MAPREDUCE-617) Streaming should not throw java.lang.RuntimeException and ERROR while displaying help Fri, 18 Jun, 10:57
Konstantin Boudnik (JIRA) [jira] Created: (MAPREDUCE-1830) Ivy2.0 has bugs: let's upgrate to 2.1.0 Tue, 01 Jun, 18:17
Konstantin Boudnik (JIRA) [jira] Created: (MAPREDUCE-1856) Extract a subset of tests for smoke (DOA) validation Fri, 11 Jun, 00:34
Konstantin Shvachko (JIRA) [jira] Created: (MAPREDUCE-1832) Support for file sizes less than 1MB in DFSIO benchmark. Wed, 02 Jun, 00:53
Konstantin Shvachko (JIRA) [jira] Created: (MAPREDUCE-1893) Multiple reducers for Slive Thu, 24 Jun, 23:16
Krishna Ramachandran (JIRA) [jira] Created: (MAPREDUCE-1850) Include job submit host information (name and ip) in jobconf and jobdetails display Wed, 09 Jun, 22:39
Krishna Ramachandran (JIRA) [jira] Created: (MAPREDUCE-1868) Add read timeout on userlog pull Tue, 15 Jun, 18:05
Krishna Ramachandran (JIRA) [jira] Created: (MAPREDUCE-1874) Enable column sorting for all JobTracker Administration UI tables Wed, 16 Jun, 23:44
Luke Lu (JIRA) [jira] Resolved: (MAPREDUCE-1442) StackOverflowError when JobHistory parses a really long line Mon, 07 Jun, 21:29
Luke Lu (JIRA) [jira] Resolved: (MAPREDUCE-1442) StackOverflowError when JobHistory parses a really long line Tue, 08 Jun, 16:43
Madeleine PIFFARETTI Question about JobQueueTaskScheduler Mon, 28 Jun, 12:45
Matei Zaharia (JIRA) [jira] Created: (MAPREDUCE-1881) Improve TaskTrackerInstrumentation Sun, 20 Jun, 02:36
Nagarajan, Senthil Kumaran (GE, Corporate, consultant) Need Sample map reduce program Fri, 18 Jun, 08:05
Owen O'Malley Re: [RT] map reduce "pipelines" Wed, 09 Jun, 18:50
Paul Yang (JIRA) [jira] Created: (MAPREDUCE-1877) getConetentSummary() for HarFileSystem throws IllegalArgumentException Sat, 19 Jun, 00:31
Ramkumar Vadali (JIRA) [jira] Created: (MAPREDUCE-1838) DistRaid map tasks have large variance in running times Wed, 02 Jun, 21:37
Ramkumar Vadali (JIRA) [jira] Created: (MAPREDUCE-1839) HadoopArchives should provide a way to configure replication Thu, 03 Jun, 01:21
Ramkumar Vadali (JIRA) [jira] Resolved: (MAPREDUCE-1839) HadoopArchives should provide a way to configure replication Fri, 04 Jun, 18:48
Ramkumar Vadali (JIRA) [jira] Created: (MAPREDUCE-1892) RaidNode can identify processed files with lesser memory usage Wed, 23 Jun, 22:16
Ramkumar Vadali (JIRA) [jira] Created: (MAPREDUCE-1894) DistributedRaidFileSystem.readFully() does not return Thu, 24 Jun, 23:38
Ravi Gummadi (JIRA) [jira] Created: (MAPREDUCE-1828) Job doesn't fail graciously when an invalid mapred.child.env value is specified Tue, 01 Jun, 09:43
Ravi Gummadi (JIRA) [jira] Created: (MAPREDUCE-1885) Trunk compilation is broken because of FileSystem api change in HADOOP-6826 Tue, 22 Jun, 05:03
Ravi Phulari (JIRA) [jira] Created: (MAPREDUCE-1846) Add option to run Slive tests in test jar driver. Tue, 08 Jun, 00:30
Message list1 · 2 · Next »Thread · Author · Date
Box list
May 202153
Apr 2021103
Mar 202194
Feb 202187
Jan 2021101
Dec 2020115
Nov 2020117
Oct 2020128
Sep 2020198
Aug 2020139
Jul 2020148
Jun 2020112
May 2020120
Apr 2020131
Mar 2020176
Feb 2020110
Jan 2020144
Dec 201987
Nov 201961
Oct 2019123
Sep 2019171
Aug 2019150
Jul 2019133
Jun 201994
May 201980
Apr 201988
Mar 201993
Feb 2019121
Jan 2019107
Dec 201869
Nov 201895
Oct 201858
Sep 2018101
Aug 2018102
Jul 2018100
Jun 2018106
May 2018110
Apr 2018167
Mar 2018137
Feb 2018109
Jan 201886
Dec 2017166
Nov 2017224
Oct 2017175
Sep 2017146
Aug 2017187
Jul 2017129
Jun 201786
May 2017101
Apr 2017102
Mar 2017157
Feb 201781
Jan 2017109
Dec 201682
Nov 2016104
Oct 2016129
Sep 2016105
Aug 2016158
Jul 2016162
Jun 2016128
May 2016272
Apr 2016326
Mar 2016259
Feb 2016347
Jan 2016339
Dec 2015284
Nov 2015322
Oct 2015401
Sep 2015324
Aug 2015131
Jul 201589
Jun 2015116
May 2015128
Apr 2015221
Mar 2015264
Feb 2015119
Jan 201597
Dec 2014139
Nov 2014127
Oct 201480
Sep 2014152
Aug 2014203
Jul 2014601
Jun 2014214
May 201466
Apr 2014140
Mar 201498
Feb 2014120
Jan 2014107
Dec 2013105
Nov 2013114
Oct 2013155
Sep 2013142
Aug 2013173
Jul 2013179
Jun 2013229
May 2013228
Apr 2013238
Mar 2013171
Feb 2013166
Jan 2013141
Dec 2012120
Nov 2012156
Oct 2012131
Sep 2012134
Aug 2012210
Jul 2012209
Jun 2012195
May 2012144
Apr 2012226
Mar 2012287
Feb 2012321
Jan 2012441
Dec 2011329
Nov 2011359
Oct 2011516
Sep 2011616
Aug 2011408
Jul 2011265
Jun 2011232
May 2011161
Apr 201197
Mar 2011158
Feb 2011139
Jan 2011143
Dec 201095
Nov 2010128
Oct 2010100
Sep 201095
Aug 201098
Jul 2010124
Jun 2010131
May 2010109
Apr 2010125
Mar 2010167
Feb 2010168
Jan 2010124
Dec 2009122
Nov 2009118
Oct 2009158
Sep 2009144
Aug 2009196
Jul 2009525
Jun 200942