sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Kincaid <kincaid.d...@gmail.com>
Subject Strange distribution of keys among mappers
Date Wed, 19 Jun 2013 15:33:33 GMT
We're seeing a strange thing happen with a sqoop import job with the way
the key range is getting distributed among the 4 mappers that are running.
The minimum key value is 2110 and the maximum value is 288272191. We are
getting one mapper that is only getting one record to import. Here is the
distribution among the mappers:

[2110, 96092137)
[96092137, 192182164)
[192182164, 288272191)
[288272191, 288272192)

you can see that the fourth mapper is given a range with only one value in
it. Could someone help me understand what is going on?



View raw message