hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Amandeep Khurana <ama...@gmail.com>
Subject Re: set number of map tasks for HBase MR
Date Sun, 11 Apr 2010 03:04:18 GMT
You can set the number of map tasks in your job config to a big number (eg:
100000), and the library will automatically spawn one map task per region.

-ak


Amandeep Khurana
Computer Science Graduate Student
University of California, Santa Cruz


On Sat, Apr 10, 2010 at 7:59 PM, Andriy Kolyadenko <
crypto5@mail.saturnfans.com> wrote:

> Hi guys,
>
> I have about 8G Hbase table  and I want to run MR job against it. It works
> extremely slow in my case. One thing I noticed is that job runs only 2 map
> tasks. Is it any way to setup bigger number of map tasks? I sow some method
> in mapred package, but can't find anything like this in new mapreduce
> package.
>
> I run my MR job one a single machine in cluster mode.
>
>
> _____________________________________________________________
> Sign up for your free SaturnFans email account at
> http://webmail.saturnfans.com/
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message