hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sujee Maniyam <su...@sujee.net>
Subject can't run data-import and map-reduce-job on a Htable simultaneously
Date Wed, 14 Apr 2010 23:05:12 GMT
scenario:
- I am writing data into Hbase
- I am also kicking off a MR job that READS from the same table

When the MR job starts, data-inserts pretty much halt, as if the table
is 'locked out'.

Is this behavior to be expected?

my pseudo write code :
 HBaseConfiguration hbaseConfig = new HBaseConfiguration();
 Htable table = new HTable(hbaseConfig, "logs");
 table.setAutoFlush(false);
 table.setWriteBufferSize(1024 * 1024 * 12);

My MR job:
- reads from log table
- writes to another table

can I do these two in parallel?

thanks
Sujee

http://sujee.net

Mime
View raw message