hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andreas Neumann <neun...@gmail.com>
Subject Re: hadoop without append in the absence of puts
Date Fri, 24 Jun 2011 01:08:23 GMT
Thanks, Andy, we will try that.
-Andreas.


On Thu, Jun 23, 2011 at 10:42 AM, Andrew Purtell <apurtell@apache.org>wrote:

> > From: Andreas Neumann <neunand@gmail.com>
> > Actually I want compactions
>
> Fair enough but this doesn't involve META or append, I mentioned it as an
> aside.
>
> > think I also want splits, because the data is going to grow
> > over time.
>
> Examine that assumption. If you have sufficient distribution of
> preallocated regions over the cluster (according to the space of keys of the
> application) then the accumulation of additional regions will probably just
> make things slower.
>
> Anyway...
>
> > Regarding the alternative HLog implementation, yes I was
> > thinking of writing and closing the file for every WAL write.
> > But if the only writes are caused by tables structure changes
> > such as splits and reassignment
>
> Modify HLog code to always roll after a META edit and you should be good.
>
>   - Andy
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message