hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From John <johnnyenglish...@gmail.com>
Subject Re: RE: Add Columnsize Filter for Scan Operation
Date Sat, 26 Oct 2013 10:20:32 GMT
Ah, I see there is one issue left. It's not very likely that it happens,
but it could. My map() looks like this

map() {
if (row.getColumnSize < batchSize && currentRowName != lastRowName) {
   DROP ROW
   return;
}

if (row.getColumnSize < batchSize && currentRowName = lastRowName) {
 STORE FINAL RESULT INTO HBASE
}

--- // do something with the column elements
}

This works fine, BUT there is one special case. If the batch size is 100
and the row has 500 column-elements. The last row will not be stored
because the storing only happens if the last row-batch is smaller than 100
and in this case every map() call has the size 100.

So, is there a way to check if the current result is the last result? Or
maybe a method that will finaly call after all map() calls?

kind regards


2013/10/26 Dhaval Shah <prince_mithibai@yahoo.co.in>

> Cool
>
> Sent from Yahoo Mail on Android
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message