hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sandy Ryza <sandy.r...@cloudera.com>
Subject Re: Where is the map input transfered to the 'map worker'/container?
Date Mon, 07 Jul 2014 04:36:42 GMT
Hi Christian,

I'm not sure the exact code path, but HDFS, not MapReduce, is in charge of
getting the bytes from the remote node.

-Sandy


On Mon, Jun 23, 2014 at 1:57 AM, Christian Grote <
cgrote@mail.uni-paderborn.de> wrote:

> Hey,
>
> I'm looking for the place where the actual map input is transfered to the
> 'map worker'/container (in case it's assigned to a host that doesn't have
> the data already).
>
> Something similar to the copyFromHost(..) method in Fetcher.java
> (org.apache.hadoop.mapreduce.task.reduce), where the map output is
> transfered.
>
>
> Best Regards,
> Christian Grote
>
>
>
>
>
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message