hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Alves <dr-al...@criticalsoftware.com>
Subject Re: Batch update gain
Date Tue, 15 Apr 2008 17:45:45 GMT
	Yes I was thinking of batch (multiple rows) updates, but only then I
realized that the old commit with lock methods were deprecated so forget
I mentioned it.
	About HBASE-581 I'll drop my comments in JIRA.
	In another note in my application I have a region that became offline.
Is there a way of making if online again (I restarted the application
several times and it didn't help)?

David Alves
On Tue, 2008-04-15 at 09:09 -0700, stack wrote:
> David Alves wrote:
> > Hi All
> >
> >             I'm currently rewriting my own TableOutputFormat classes to
> > comply with the new APIs introduced in the latest version and I was
> > wondering if it would be valuable to rewrite them as buffered writers,
> > meaning keeping a predetermined set of records (set by size to avoid OOME)
> > before commiting them to HBase.
> >   
> Commits are by row.  Are you talking of batching up rows before 
> forwarding them to hbase?
> >             What are your thoughs about this?
> >
> >             In another note I think it would be valuable to rewrite the
> > TableInputFormat class to be extendable. For example in my case I needed a
> > Filtered (RegExpRowFilter) TableInputFormat and could not extend the
> > original because its instance of HTable is package protected.
> >   
> This needs to be done before 0.2.0 release.   Its been on my mind.  I 
> just made a JIRA for it.  Dump any thoughts you have on how it might 
> work into hbase-581.  At a minimum, at note on what currently prevents 
> your being able to subclass.
> If you are currently working on this, I could do the hbase end for you.  
> Just say.
> St.Ack

View raw message